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ABSTRACT 

The Prescriptive Mathematics Inventory (MU) -Level B 
and a. Pupil identification Form (PID) vexe administered to 22,055 
sixth graders in. Texas, Results frpm the PMI are reported in terms of 
the percentage of students marking the correct response for each of 

.209 objectives. Panels, of mathematics teachers and of mathematics 
experts rated 40 of tJiese objectives as. "basic"; this report 

.summarizes, the basic objectives and gives the percentage of sixth 
gradeirs mastering the objective as shoim by *^he PMI. In addit:ion, 
students* .perfoi:manpe on each of the 209 <d)jectiyes was analyzed on 
the basis of pupil characteristics obtained through the PID and 
according to the characteristics of the schools they attended. 
Result^ shovied %iride variations in achievement o.f^ objectives; for each 
objective, . wide variations in performance were found, among pupils of 
various ethnic groups, among students of scixx>l8 serving communities 
of vairious. sizes and. types, and between, pupils having high and low. 
educational emphasis at home. Possible uses for this report are 
suggested. (Author/pT) 
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Revie>A« of local education agencies pertaining to compliance with Title 
VI Civil Rights Act of 1964 and with specific requirements of the 
Modified Court Order, Civil Action No. 5281, Federal District Court, 
Eastern District of Texas, Tyler Division are conducted periodically by 
staff representatives of the Texas Education Agency. These reviews 
cover at least the following policies and practices: 

(1) acceptance policies on student transfers from other school 
districts; 
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basis; 
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and staff members who work with children; 
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In addition to conducting reviews, the Texas Education Agency staff 
representatives check complaints of discrimination made by a citizen or 
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Where a violation of Title VI of the Civil Rights Act is found, the 
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5281 that cannot be cleared through negotiation, the sanctions required 
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FOREWORD 



As a part of its continuing effort to assess the educational needs 
of Texas pupils, the Texas Education Agency tested over 22,000 
sixth graders with criterion-referenced mathematics and reading 
tests in the fall of 1971. Although assessment information was 
obtained on regional and state bases, a major purpose of this 
activity was to provide classroom teachers with information on 
individual students which could facilitate instructional plan- 
ning. 

This study and the resulting reports will be evaluated in terms 
of their usefulness in assisting educational leaders in improv- 
ing the quality of Texas elementary and secondary public schools. 

If you have questions about the study or desire further clari- 
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ABSTRACT 



In the fall of 1971, the Prescriptive Mathematics Inventory 
(PMI) -Level B and a Pupil Identification Form (PID) were 
administered to 22,055 pupils enrolled, at the sixth -grade 
level, on a representative sample of Texas campuses. 

Results from the PMI are reported in. terms of the percentage 
of pupils marking the correct response for each of 209 objec- 
tives. Each correct response reflects achievement of a mathe- 
matics objective. The objectives were derived through content 
analysis of mathematics textbooks. The PID asked each pupil 
to indicate his sex ar^J ethnicity, to respond to several items 
regarding the educational emphasis of his home, and to indicate 
whether he feels he is good in arithmetic and whether he feels 
he is good in reading. 

Panels of mathematics teachers and of mathematics experts were 
asked, independently, to rate the objectives as "basic" or as 
"desirable"; those objectives selected as "basic" are presented 
in the report. 

Since presentation of the item used as the measure of achieve- 
ment for each of the 209 objectives would be voluminous, 21 
objectives were selected as representative. The item for 
measuring the achievement of each representative objective 
is presented in this report. 

in addition, the pupils' performance on each of the 209 objec- 
tives of the PMI was analyzed on the basis of pupil characteris- 
tics (obtained through the PID) and according to the character- 
istics of the campuses on which the pupils were enrolled. 

Wide variations in achievement were found among the objectives- 
22 were achieved by less than 2% of the pupils but 14 of the 
209 objectives were achieved by at least 70% of the pupils. 
Approximately one quarter of the objectives were achieved by 
at least half the pupils; another quarter were achieved by 
less than 10% of the pupils. 

For each of the objectives, wide variations in performance were 
found among pupils of various ethnic groups, among pupils from 
campuses serving communities of various sizes and types, and 
between pupils from homes having high and low educational 
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emphasis* On half of those objectives achieved by at least 
10% of the pupils, the percentage of achievers among the 
"Other" (primarily Anglo) pupils was at least double the 
percentage of achievers among the Black pupils. The general 
pattern was for pupils on campuses serving suburban communities 
to have the highest percentage of achievers, followed in order 
by those on campuses serving cities of less than 200,000 popu- 
lation, rural areas, cities of 200,000-500,000 populations, and 
cities of over 500,000 population. Pupils on campuses not 
participating in Title I, Elementary and Secondary Education 
Act, evidenced only a slightly, but consistently, superior per- 
formance on the objectives. On most of the objectives the 
girls had a higher percentage of achievement than the boys. 
Interesting departures from the predom.inant performance pat- 
terns described above were found in the case of some objectives. 

Chapter VI describes possible uses of the report. The percent- 
age of pupils who should be able to give the correct response 
was not established for each objective. The causes underlying 
high or low performances on the objectives were not identified. 
The report is an assessment of the status of pupils at the 
beginning of the sixth grade. The report should not be con- 
strued as an evaluation of the effectiveness of sixth-grade 
instruction nor should the pupil categories by which data is 
reported be regarded as "causes" of high or low performance. 
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I. INTRODUCTION 



The 1971 Texas Assessment of Reading and Mathematics is one 
of a series of assessment studies being conducted by the Texas 
Education Agency with the cooperation of regional education 
service centers and schools. These studies are a part of the 
Lonq-Ranqe Plan for Needs Assessment (see Appendix A) in Texas 
that has the purpose of establishing the status of students in 
reference to the Goals for Public School Education in Texas , 

After consultation with various groups of educators, reading 
and mathematics were chosen as priority areas of concern in 
which to determine the relationship between the students* status 
and the Goals. 



RATIONALE 

Developing the competencies of students in reading and mathe- 
matics has long been a goal of all public schools because 
student mastery of skills and concepts in these two areas 
is considered a prerequisite for attaining other student de- 
velopment goals. Little information about student performances 
in relation to specific reading and mathematics skills and 
concepts has been made available to curriculum planners at the 
local, regional, or state levels. 

This study also provides evaluative information about mathe- 
matics objectives that can be considered "basic'* for students 
to master in order to function in society, as distinguished 
from those objectives that are "desirable" for some students 
to master. 

OBJECTIVES 

The objectives for the 1971 Texas Assessment of Reading 
and Mathematics follow: 

To provide educators in participating schools 
useful information about the performances of 
their pupils relative to specific skills and 
concepts in reading and mathematics. The degree 
to which this objective is met will be determined 
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through the use of questionnaires presented to 
school personnel. 

To develop through the use of criterion- 
referenced testing a more universal under- 
standing of, and a positive attitude toward, 
the use of this diagnostic and prescriptive 
information with students. Evaluation of the 
accomplishment of this objective will be 
measured through the use of questionnaires 
sert to teachers. 

To develop sets of basic objectives for the areas 
of reading and mathematics that will be useful 
for program planners and can serve as benchmarks 
for later assessments. The degree to which this 
objective is accomplished will be determined by 
surveying educational planners. 

To furnish regional education service center (ESC) 
personnel with summary information about the 
performances of pupils in their regions rela- 
tive to specific skills and concepts in reading 
and mathematics. The usefulness of this infor- 
mation will be determined from personal inter- 
views with ESC personnel. 

To furnish Texas Education Agency personnel with 
state summary information about the performance 
of pupils on a selected set of reading and mathe- 
matics objectives. The usefulness of the state 
summary information for Agency divisions will be 
evaluated through structured interviews with 
staff members within the divisions* 

To disseminate information from the assessment 
that will be useful for 

pre-service and in-service teacher education 
programs 

up-dating educational programs for reading 
and mathematics including programs for 
different population groups 
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planning proarams to alleviate educational 
needs . 

Follow-up evaluation forms will be used to deter- 
mine whether the assessment reports have reached 
appropriate audiences, and if so, how the informa- 
tion is used. 
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II, PROCEDURES 



DECISIONS ABOUT THE NATURE OF THE ASSESSMENT 

Pilot study - During the spring of 1971, a pilot study was 
conducted in one region of Texas to determine whether or not 
the proposed reading and mathematics assessment instruments 
would yield results that were useful to teachers for the class- 
room instruction of pupils. Also considered was whether results 
from these same instruments would produce summative information 
that could be used by personnel in regional education service 
centers and the Texas Education Agency. The pilot study was 
used to evaluate the methods of communicating about assessment 
information, delivering assessment mater ials , and returning 
test results to schools. Teachers in the schools that partici- 
pated in the pilot study were surveyed to determine their 
perceptions about the assessment results and the usefulness of 
the information they received from the tests for classroom 
planning. 

An evaluation of the methods and instruments used for conduct- 
ing the pilot study and the survey about the usefulness of test 
results for classroom instruction showed some changes should be 
made for the statewide assessment. Two major alterations were 
made. A criterion-referenced reading test was developed for 
the statewide assessment project since the standardized diag- 
nostic reading test did not yield enough information about 
pupil mastery of specific skills and concepts. A grade level 
instead of an age group of students to be assessed was selected 
because most schools have students grouped by grades. 

Students to be assessed - The students that would participate 
in the assessment project would be those at the sixth-grade 
level. This level of the pupils' educational experience was 
chosen for assessment because at this point in the pupils' 
progress through school they would have been exposed to most 
of the basic skills and the usual tendency for some students 
to drop out of school would not have begun. It was assumed, 
then, that by assessing • the performances of sixth . graders a 
better representation of pupil performances would be obtained. 
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Developing an assessment sample - The Texas Education Agency 
wanted the information that was collected to serve a dual 
role of assisting in instruction in the classroom as welJ as 
providing a statewide assessment. The sampling procedure 
chosen was that of selecting a sample of schools representative 
of the state and then assessing the total sixth-grade popula- 
tion in these schools. 

Selection of assessment instruments ~ Part of the rationale 
for conducting the assessment was to determine pupil perfor- 
mances in relation to a common set of specific objectives for 
both the areas of reading and mathematics. It was decided that 
the information from a testing program that reported results in 
terms of a comparison of pupils would not provide enough specif- 
ic information for curriculum planners to use in renewing or 
developing programs. As a result, criterion-referenced test 
instruments were chosen for the study because this type of 
testing is designed to measure the relationship between stated 
objectives and student mastery of these objectives, in order 
to gather additional information about students that could be 
combined with the students' test scores for further analysis 
of the assessment results at the state level, a one-page 
questionnaire was developed to be administered with the test 
instruments . 

Administration of assessment instruments - The test instruments 
and the one-page questionnaire were administered by the staff 
of each school that participated in the assessment study. No 
special arrangements were made by the staff of the regional 
education service centers or the Texas Education Agency to 
administer the tests in schools. Since the tests were designed 
as "power tests" (tests to measure a level of performance unaf- 
fected by the speed of response, so no time limit is imposed), 
it was recommended, at pretest workshops and in literature sent 
to schools that the tests be administered during the regular 
class time scheduled for mathematics. 

Selection of mathematics objectives - It is impossible to 
assess the performance of students in every skill or concept 
area for mathematics, so a selection procedure was used. The 
objectives for mathematics were chosen from the major skill 
or concept areas treated in the state-adopted textbooks. The 
textbook analysis and objective writing tasks were performed 
by the test contractor. These objectives were then reviewed 
by the mathematics consultants at the Texas Education Agency 
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and adapted for use in this assessment study. In addition, in 
order to gain further insight about the objectives, it was 
decided to start to develop a listing of mathematics objec- 
tives that could be considered to be "basic" or "desirable," 
that could be used in later assessments, and that would be 
useful for the development of objectives under the Goals for 
Public School Education in Texas. 



THE ASSESSMENT INSTRUMENTS 

The Prescriptive Mathematics Inventory - Level B (PMI-B) - This 
criterion-referenced mathematics test published by CTB/McGraw- 
Hill was chosen for this assessment. The PMI-B was designed to 
measure student mastery of 212 mathematics objectives in 33 
general areas of mathematics. The objectives were derived 
through an analysis of the major series of mathematic text- 
books that are used in schools including the five series of 
textbooks on the state-adoption list in Texas. They include 
skills and concepts usually covered in mathematics to the end 
of the sixth-grade level. For the PMI-B one test item is used 
to measure mastery of each objective. A type of open-ended 
response to the test items is incorporated into the test de- 
sign to help eliminate guessing since the one-to-one ratio of 
item to objective is used. The students write their responses 
to items on a space in the answer grid and then code their 
answers for scoring purposes. This test has no time limit and 
is designed to be administered in the classroom during the reg- 
ular period for mathematics instruction. The PMI-B was admin- 
istered to 22,055 sixth-grade students through this assessment 
study. 

The Pupil Identification Form (PIP) - A one-page form developed 
by the Texas Education Agency was used in this study in order 
to gather additional demographic data about students that were 
not requested in personal data sections of the test. Also, the 
PID included some perceptional questions for students to answer 
The information collected through this form was combined with 
the students' test scores to provide additional variables for 
the analysis of the assessment data. Through use of the PID, 
the Migrant Education Section and the Special Education Divi- 
sion of the Agency were able to gather some information about 
students in the assessment enrolled in their programs. Some 
of the results from questions asked on the PID have not been 
reported separately but were combined to form an Educational 
Emphasis Index. The teachers were asked to verify the students 



6 



responses to the ethnicity, migrant program, and special 
education program questions but were not asked to check the 
other questions about student perceptions. (A PID form is 
shown in Appendix B.) 



SAMPLING 

The desired sample of campuses was to be representative of the 
Texas campuses which offered instruction at the sixth-grade . 
level. All pupils to whom instruction in mathematics was 
given at the sixth-grade level on the selected campuses were 
to be tested. 

The statewide sample of campuses offering instruction at the 
sixth-grade level was to consist of 20 subsamples, one for 
each of the 20 education service center regions of the state. 
E^ch of the 20 regional samples was to contain approximately 

10% of such campuses in the region 

10% of the sixth-grade pupils in the region 

the same ethnic distribution of sixth -grade pupils 
as the region 

the same proportions as the region of campuses 
from large cities, small cities, towns, suburbs, 
and rural areas, and 

the same proportion of sixth-grade campuses 
participating in Title I as in the region. 

Procedure for sample selection - A list, by education service 
center region, was obtained of all Texas campuses which enrolled 
pupils, in the fall of 1970, at the sixth-grade level. The 
campuses of each of the 20 education service center regions were 
formed into 10 strata on the basis of (1) the size and type of 
community in which the campus is located, and (2) whether or 
not the campus participated in a Title I ESEA, program during 
the last school year. The size-and-type of community strata, 
a collapsing of the categories used in the USOE Program Ref- 
erence File for the 1970-71 school year, were 

located in a city of over 200,000 population 
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located in a city having between 50,000 and 200,000 
population 

located in a town having less than 50,000 population 

located in a suburb of a city having over 50,000 
population 

located in a rural area. 

For each of the 20 ESC regions independently, every tenth cam- 
pus from a random start was selected from each of the 10 strata. 
The process of stratified random sampling did not, for some 
ESC regions, yield a list of campuses whose sixth-grade pupils 
constituted approximately 10% of the sixth-grade pupils of 
their region, nor did some samples approximate the sixth- 
grade ethnic distribution of their region. Minimal substitu- 
tions of campuses within the region were made until 

at least 8% but not more than 12^o of the sixth- 
grade pupils of the region were on the selected 
campuses, and 

the percentage which each ethnic group consti- 
tuted of the selected campuses was within 5 
points of the percentage which each ethnic group 
constituted of the regional population of sixth 
graders . 

The obtained sample - A comparison of the population with the 
sample of campuses drawn from each ESC region — by size and 
type of community served by the campns and by participation 
of the campus in Title I, ESEA — appears as Appendix C. The 
appendix also compares the pupil population of each ESC re- 
gion with the number of pupils who responded to the PMI. The 
regional test coordinators were very effective in obtaining 
the cooperation of the administrators of the selected schools. 
Awareness of the biasing effect upon the sample of substitu- 
tions led to almost all of the selected campuses administering 
the tests to their sixth-grade pupils. The departures were 
limited to loss of two campuses and to nine substitutions 
(most of which involved very small sixth-grade enrollments) . 

Approximately 10% of the Texas campuses teaching at the sixth- 
grade level administered the PMI and approximately 10% of the 
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pupils being taught at the sixth-grade level responded to the 
PMI. 

The distribution of campuses on which the PMI was administered 
closely approximated the distribution of sizes and types of 
campuses in the state. Table A shows the number of campuses 
on which the PMI was administered and the number of pupils 
from whom PMI records were obtained. 



TABLE A: Campuses Administering and Pupils Responding 
to the PMI/ by Size and Type of Community in 
which Campuses are Located 





Number 


Size and Type of Community 


Title I 


Campuses 

Non-Title I 


Pupils 


Large City (over 200,000) 


18 


37 


6527 


Small City (50,000-200,000) 


16 


18 


3126 


Town (less than 50,000) 


53 


23 


7649 


Suburb 


6 


11 


2583 


Rural Area 


49 


11 


2170 


All 


142 


100 


22055 



Table B compares the ethnic distribution of the sample of 22^055 
responding pupils with the state's ethnic distribution of pupils 
at the sixth-grade level. 

TABLE B: Ethnic Distribution of Respondents to the PMI 

and of State Enrollment at the Sixth-Grade Level 

Mexican American/ Other (Anglo, Oriental Unknown 
Black Spanish surnamed and American Indian) 

Respondents to 14.8% 19.2% 55.8% 10.2% 

the PMI 

State enroll- 14.8% 21.5% 63.7% -0- 

ment at the 

sixth-grade 

level 

in each of the 20 ESC regions of the state^ the respondents 
to the PMI constituted at least 7% and not more than 13% of 
the pupils enrolled at the sixth-grade level. 
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ANALYSIS OF THE ASSESSMENT DATA 

Reporting results from criterion-referenced tests - Criterion- 
referenced tests are developed for the distinct purpose of 
determining the relationship between performance and objec- 
tive. They are not normed tests so the usual reporting of 
results in reference to a population based on a "normal curve" 
is not relevant. Consequently, statistical terms that are 
often used to report results — such as stanines, percentile 
ranks, and other kinds of standard scores — cannot be used with 
the results from criterion-referenced tests. Group results 
derived from this type of testing procedure are usually 
reported in terms of the percentage of persons mastering the 
objective. 

Reports furnished to schools that participated in this study - 
To provide useful information about students for classroom 
instructional purposes, each school that participated in this 
assessment was provided with the following kinds of reports 
for mathematics. 

Individual student reports: 

A report for each student to show his status 
in relation to the mathematics- objectives was 
prepared for teacher and student. 

Another individual report grouped the 
objectives that the student did not master 
and gave page references in the textbook 
or workbook that might assist the student 
in gaining mastery of the objective. 

Group reports of student test results: 

A school report that showed the percen-'ages 
of sixth-graders in the school who mastered 
each mathematics objective was provided. 

A class report was made for each teacher which 
gave the class percentage of pupils who mastered 
each objective. 

Also provided was a report that grouped the 
students in each class by the objectives 
that their test performances indicated the 
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students were having difficulty in mastering, 
and gave pertinent page numbers in the text- 
book and workbook to assist the pupils with 
instruction in mastery of these objectives. 

Master Reference Guide: 

Each teacher was asked to furnish the name of the 
textbook that the school adopted from the state 
list that was used with the class. The teachers 
later received a guide that listed each mathe- 
matics objective with page references from the 
textbook that they listed. Master Reference 
Guides for the fourth-and fifth-grade levels for 
the same series of textbooks listed by the teacher 
were also made available. 



REPORTING THE STATEWIDE DATA 

The results used for this report were derived from information 
supplied by the testing company and from additional analysis 
of the data done by the Texas Education Agency. The informa- 
tion furnished by CTB/McGraw-Hill was compiled through total- 
ing the results from the sample of schools into regional 
grouping and then summing the 20 regional groups for the state 
results. These results included a state percentage of students 
who had mastered each mathematics objective, and separate 
reports for each item on the Pupil Identification Form giving 
the percentages of mastery in relation to the students' 
responses on this form. Further processing and analysis of 
the information was done by the Agency after receiving the 
computer tapes from the test company. The following is a 
brief description of the analysis plan followed by the Agency. 

Analysis plan - This study was not designed to identify the 
factors underlying pupil performance. The analyses do, how- 
ever, compare the performance status of 

male and female pupils 

Black, Mexican American, and "Other" (includes Anglo, 
Oriental, and American Indian) pupils 
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pupils enrolled on campuses serving various 
sizes and types of communities: cities of over 
500,000 population, cities of 200,000 to 500^000 
population, cities of less than 200,000 popula- 
tion, suburban communities, and rural areas 

• pupils enrolled on campuses receiving and not 
receiving funds from Title I, ESEA 

. pupils who gave "Yes" and "No" responses to the 
PID question "Am I a good reader?" 

pupils who gave "Yes" and "No" responses to the 
PID question "Am I good in arithmetic?" 

pupils who obtained a high rating and pupils 
who obtained a low rating on an Educational 
Emphasis index (described in the next sub- 
section)* 

The information used for establishing these categories came 
from the Pupil Identification Form, from demographic items 
asked at the beginning of the test instruments, and from the 
test results. The results from the migrant program question 
on the Pupil Identification Form did not provide enough cases 
to form a basis for comparison and the question asking stu- 
dents about special education programs did not make enough 
distinctions among the types of programs. 

The Educational Emphasis Index - Student responses to a 
series of questions asked on the pupil Identification Form 
were used to establish an "educational emphasis of the home" 
index. This index was formed to study certain factors pre- 
sented by the pupils' background. Four questions from the 
pupil Identification Form were used to compile the Educational 
Emphasis Index and arbitrary weights were assigned for each 
response to the questions. See Table C. 
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TABLE C: Questions from the Pupil Identification Form 
Used for Compiling the Educational Emphasis 
Index and the Weights Assigned to Responses 



Number and Question Weight of Response 



A 


Outside of school, how long do I usually watch TV 






on each school day? 






(1) 


None 


0 




(2) 


1 or 2 hours 


1 




(3) 


3 or 4 hours 


o 




(4) 


5 or 6 hours 


1 




(5) 


more than 6 hours 


0 


7 


Do I read 


books for fun, even when they are not for 






school? 






(1) 


No 


0 




(2) 


Yes 


2 


8. 


How many books do we have at home? 






(1) 


We have no encyclopedias and less than 25 








other books. 


0 




(2) 


We have no encyclopedias but we have 25 or 








more other books. 


1 




(3) 


We have some encyclopedias and less than 








25 other books. 


1 




(4) 


We have some encyclopedias and 25 or more 








other books. 


2 


9. 


Do we get 


a daily newspaper, or magazines in the mail? 






(1) 


We get no newspapers and no magazines* 


0 




(2) 


We get no newspapers, but we get magazines. 


2 




(3) 


We get no magazines, but we get a daily 








newspaper. 


2 




(4) 


We get magazines and a daily newspaper. 


4 



The responses of students to these questions were summed 
according to the weights assigned for the responses. After 
listing the possible response scores on a continuum that 
ranged from a high of 10 to a lov; of 0^ the number of students 
having each response score was compiled. The 15% of the stu- 
dents having the highest response scores was used to establish 
the "high educational emphasis'* group and the corresponding 
percentage of students having the lowest response scores 
used in establishing the "low educational emphasis" group. 
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SELECTING REPRESENTATIVE OBJECTIVES FOR REPORTING 

Presenting an analysis of pupil performance on every objective 
would cause this report to be too lengthy. A group of objec- 
tives representative of the total sets of objectives for 
mathematics was selected. The objectives that were selected 
are discussed in Part IV - Results on a Representative Group 
of Objectives. 

In order to ensure the representativeness of the objectives, 
certain procedures were followed which involved the use of 
some mathematical formulas to establish the sensitivity of 
each objective to the analysis categories used in this 'tudy. 
The term "sensicivity" is used here to mean the extent to 
which performances on each objective vary among categor- 
ies of the analysis plan, e.g., ethnicity. The objectives were 
ordered from least sensitive to most sensitive. (See Appendix 
D.) 

It was decided that 10 percent of the mathematics objectives 
would be selected. To achieve a balanced sampling, the list-- 
ing of objectives under general areas was used and each objec- 
tive was identified as either being "basic" or "desirable." 
(See Part III of this report.) The sample selected was to 
represent approximately the same ratio of objectives by gen- 
eral areas and by "basic" or "desirable" as in the total set 
of objectives. 

The mathematics objectives were blocked into groups of ten 
according to the order of their sensitivity to provide a 10 
percent sample. This process resulted in 21 groups; one ob- 
jective was chosen from each group. This objective was se- 
lected by consideration of the general area of mathematics 
it represented and whether it was "basic" or "desirable." 

The relationship between all *209 measured objectives and the 
•sample of 21 representative objectives c^n be seen, with re- 
spect to performance of ethnic groups, in Table D. 



* Because of errors in three test items, pupil performances 
are reported on 209 of the 212 mathematics objectives. 
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TABLE D: Number of PMI Objectives in Each 
percentage Category of Mastery 



Percent of 
Mastery 


Black 


Mex^'can 


American 


Other(Angl 
American 


0, Oriental 
Indian) 




All 
Objs 


*Repr. 
. ** Objs. 


All 
Objs. 


Repr. 
Objs. 


All 
Objs. 


Repr. 
Objs. 


75-99% 


1 


0 


4 


1 


18 


3 


50-74 


14 


3 


38 


6 


51 


6 


25-49 


54 


8 


58 


5 


49 


6 


0-24 

1 


L40 


10 


109 


9 


91 


6 



* Repr» - .abbreviation for representative 
Objs, - abbreviation for objective 
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III. BASIC LEARNER OBJECTIVES FOR MATHEMATICS 



A part of the assessment of mathematics involved an investiga- 
tion to identify basic objectives. The purpose for this activ- 
ity was to idP'-itify a set of objectives that could be considered 
basic — i.e., pupils mastering this group of objectives would 
be able to function at the consumer level in society. The 
information about basic objectives and the status of the pupils 
in relation to these objectives can be used as benchmarks for 
planning at the local, regional, and state levels. 

PROCEDURES FOR SELECTION 

It was decided early in the assessment project to use the list 
of objectives that had been developed for the Prescriptive 
Mathematics Inventory - Level B as the master list for choos- 
ing basic objectives. This list was selected because the 
PMI-B objectives were written in measurable terms, and they 
included most of the mathematics curriculum content through 
the sixth-grade level that is taught in Texas schools. 

The PMI-B objectives were then organized into a questionnaire 
format that listed the objectives and provided a scale by 
which a person could rate each objective. The options pre- 
sented for rating each objective included the phrases "appro- 
priate for all students," "appropriate for many students," and 
"appropriate for few students." The directions for the ques- 
tionnaires explained that the point of reference for giving 
opinions about the objectives was a student at the sixth-grade 
level (usually an eleven- or twelve- year-old pupil) . The 
objectives identified as "appropriate for all students" would 
be considered as basic objectives for mathematics. 

Forms of this questionnaire were disseminated to two selected 
groups of educators. One group consisted of a sample of 
sixth-grade mathematics teachers randomly selected from those 
schools that had participated in the Assessment Project. 
Since the mathematics objectives review was included as a 
part of an evaluative survey to secure teachers* opinions about 
criterion-referenced testing, each mathematics teacher selected 
in the sample was sent a subset of all objectives for racing. 
The responses were then collated in order to compile the opin- 
ions of the mathematics teachers on all objectives. 
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A panel of mathematics experts which included supervisors, 
curriculum specialists, university professors, and other 
teachers from schools not participating in the assessment 
was selected by the staff in the Division of Program Develop- 
ment in the Texas Education Agency. This group of experts 
received the total list of objectives for their review and 
opinions . 

The response "appropriate for all students" was assigned a 
weight of 1; "appropriate for many students," a weight of 2; 
and "appropriate for few students," a weight of 3. For each 
objective a mean was calculated from the responses given by 
each group of educators. An objective was deemed "basic" if 
its mean was 1.5 or less. Forty-two objectives were placed 
in the "basic" category by both the teachers and the mathe- 
matics experts. In addition to the objectives on which there 
was consensus, the teachers identified six more objectives a^ 
basic; the mathematics experts felt an additional 41 of tlrc} 
objectives were basic. 

Of the six objectives identified as basic by the teachers but 
not by the mathematics experts, five were in areas of mathe- 
matics from which the experts did not select any objectives 
as basic. These areas are rounding numbers (estimation), 
identity element, and statis'^'-ics (computing a mean) . Other- 
wise the teachers and mathematics experts were in agreement 
on the major areas of mathematics from which objectives were 
identified as basic. The experts rated more of the objectives 
within these areas as basic. -For instance, in the area of 
operations on the number line, the mathematics teachers rated 
one objective as basic; the mathematics experts agreed with 
teachers about this objective, but also selected an additional 
five objectives as appropriate for mastery by all students. 
The only areas in which the experts ranked objectives as basic 
and the teachers selected none were multiplication and divi- 
sion of positive fractions, and addition, multiplication, and 
division of decimal numbers. The difference between the two 
groups in the selection of basic objectives can perhaps be 
attributed to the differing perspectives of the groups. The 
teachers might have been more inclined to consider "basic" 
those objectives covered at the sixth-grade level and not to 
rate as "basic" those objectives they felt were too difficult 
for all or most of the sixth graders to master. The mathe- 
matics experts probably looked at the objectives from a 
broader frame of reference and paid more attention to what 
they thought would be basic for all students and were less 
cognizant of what was taught at the sixth-grade level. 
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RESULTS 



The remainder of this section contains a summary of the basic 
objectives that were selected. The objectives were discussed 
under the general headings of the area of mathematics to 
which they relate. Also, the percentage of sixth graders in 
the assessment that mastered the objective is stated in 
parentheses. Appendix E lists each of the PMI objectives 
and gives the results for each group of reviewers. 

Operations on the number line 

The first area of mathematics described in the list of objec- 
tives involves operations on the number line. The two panels 
of reviewers agreed on one basic objective from this area: 
"when given a number line showing the operation of addition 
of whole numbers and an open mathematical sentence, the stu- 
dent should be able to complete the mathematical sentence to 
complete the operation" (49% of the sixth graders were able 
to do this) . The panel of mathematics experts identified 
five additional objectives from this area as basic. These 
objectives require the students to be able to specify a given 
point on a number line divided into fourths as a mixed number 
(30%) 7 and to use number lines that show the operation of 
subtraction of whole numbers (42%) , the operation of addition 
of mixed numbers (8%) , the operation of subtraction of mixed 
numbers (10%) , and the operation of multiplication of mixed 
numbers (5%) to complete a mathematical sentence that describes 
the operations. 

Addition of whole numbers 

Both the mathematics teachers and experts agreed that the 
objectives given for the addition of whole numbers were basic 
for sixth-grade students. These objectives involved the stu- 
dents ' being asked to add 

four-digit whole numbers with regrouping (66%) 

five-digit whole numbers with regrouping (75%) 

a column of five or fewer three-digit whole 
numbers with regrouping (67%). 
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At least two-thirds of the students tested answered the items 
correctly for these objectives. 

Subtraction of whole numbers 

All of the objectives listed for this area were selected as 
basic by both review groups. The objectives called for the 
same type of operation, subtraction of whole numbers with 
regrouping, but differed in the number of digits the student 
would be required to use. For instance^ the students were 
asked to subtract with regrouping a two-digit number from a 
two-digit number (mastered by 76% of the sixth graders), a 
three-digit number from a three-digit number (70%) , a four- 
digit number from a four-digit number (60%), and a five-digit 
number from a five-digit number (57%) . 

Multiplication of whole numbers 

The mathematics experts and teachers agreed that 5 out of 12 
objectives given for the multiplication of whole numbers 
should be considered as basic. The five basic objectives and 
the percentage of correct responses by the sixth-grade stu- 
dents to the test items measuring these objectives are as 
follows : 

Write a given repeated addition problem as a 
multiplication problem and compute the answer. (48%) 

Multiply a one-digit whole number by a one- 
digit whole number. (Basic fact) (66%) 

Multiply a two-digit whole number by a one- 
digit whole number. (7^) 

Multiply a three-digit whole number by a one- 
digit whole number. (62%) 

Multiply a four-digit whole number by a one- 
digit whole number. (53%) 

The mathematics experts considered four additional objectives 
as basic for sixth- grade students. 

Find the total number of elements in a rectang- 
ular array by using multiplication. (82%) 
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Multiply a two-digit whole number by a two- 
digit whole number. 



(5^/o) 



Multiply a three-digit whole number by a two 
digit whole number. 



(40%) 



Multiply a three-digit whole number by a three 
digit whole number. 



(32%) 



Division of whole numbers 

The review panels reached agreement about six of the objec- 
tives pertaining to the division of whole numbers. The opera- 
tions .cited for each of these objectives were similar in that 
each required the student to be able to divide one number by 
mother number. The objectives differ by the number of digits 
in each number and whether or not the answer has a remainder. 
The six objectives viewed as basic by both groups require the 
student to be able to divide a two-digit number (73%) and a 
three-digit number (41%) by a one-digit number with no re- 
mainder. The objectives considered basic require division of 
a two-digit number by a one-digit number with a remainder (58%) , 
a three-digit number by a one-digit number with a remainder 
(55%)^ a four-digit number by a one-digit number with a re- 
mainder (32%) , and a three-digit number by a two-digit number 
with remainder (32%) . 

The panel of mathematics experts named two additional objec- 
tives as basic. The objectives are concerned with dividing 
a two-digit number by a two-digit number with a remainder* 
and dividing a four-digit number by a two-digit number with 
a remainder (33%) . 

Addition of positive fractions • 

Four of the nine objectives dealing with the addition of posi- 
tive fractions were rated as basic by both the mathematics 
experts and teachers. These four objectives follov/: 



Given a rectangle that has been divided into 

a number of equal squares of which some are shaded 



*Test item did not measure this objective. 
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the student will specify the fractional part 
of the rectangle that is shaded. (Pictorial 
fractions) (36%) 

Rename a fraction by reducing the numerator 

and denominator to lowest terms. (14%) 

. Add three like fractions without regrouping. (75%) 

. Add two like fractions with regrouping. (24%) 

The following objectives were rated as basic only by the 
mathematics experts: 

Convert a fraction expressed in lowest terms 

into higher terms. (Equivalence) (24%) 

. Add two unlike fractions without regrouping, (17%) 

. Add two mixed numbers without regrouping, (16%) 



Subtraction of positive fractions 

Two of the five objectives dealing with subtraction of posi- 
tive fractions were considered basic by both groups. The two 
objectives were concerned with subtracting like fractions 
without regrouping (48%) and subtracting like fractions with 
regrouping (9%) . The mathematics experts selected two addi- 
tional objectives as basic: subtracting unlike fractions 
without regrouping (13%), and subtracting mixed numbers with- 
out regrouping (9%) . 

Multiplication of positive fractions 

The mathematics experts rated three of the eight objectives 
dealing with the multiplication of positive fractions as basic. 
The mathematics teachers did not list any of the objectives 
in this list as basic. The objectives the mathematics experts 
selected aret 



Multiply a proper fraction 
tion. 

Multiply a whole number by 
Multiply a whole number by 



by a proper frac- 

(38%) 

a proper fraction. (22%) 
a mixed number. (10%) 
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Division of positive fractions 



The mathematics experts named two of these objectives as basic 
while the mathematics teachers chose none. The two objectives 
selected by the mathematics experts are to divide a proper 
fraction by a proper fraction (1%) and divide a whole number 
by a proper fraction (3%) . 



Addition of decimal numbers 



Again, the mathematics experts selected several objectives 
from this area of mathematics as basic while the mathematics 
teachers selected none. The experts listed the following six 
objectives as basic. 

Convert a proper fraction to a decimal frac- 
tion. (3%) 

Add two decimal fractions each with one 

decimal place without regrouping. (67%) 

Add two decimal fractions each with two 

decimal places without regrouping. (63%) 

Add two decimal fractions each with three 

decimal places without regrouping. (57%) 

Add two decimal fractions each with one 

decimal place with regrouping. * 

Add two decimal numbers each with two 

decimal places with regrouping. (48%) 



Subtraction of decimal numbers 



The mathematics experts selected several basic objectives 
from this group; the mathematics teachers selected one. Both 
review groups chose being able to subtract a one-digit decimal 
fraction from a one-digit decimal fraction without regrouping 
as a basic objective (72% of the sixth graders were able to 



*Test item did not measure this objective. 
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do this) . The mathematics experts named basic objectives 
that would require subtracting 

a two-digit decimal fraction from a two-digit 
decimal fraction without regrouping (63%) 

a one-digit decimal fraction from a decimal 

number with one decimal place with regrouping (43%) 

a decimal number with two decimal places from 

another decimal number with two decimal places 

with regrouping, (37%) 

Multiplication of decimal numbers 

None of the mathematics teachers rated the eight objectives 
for multiplication of decimal numbers as basic learnings for 
sixth-grade students. The mathematics experts, however, 
identified the following two as basic objectives for all stu- 
dents : 

Multiply a two-digit whole number by a one- 
digit decimal fraction. , (40%) 

Multiply a two-digit whole number by a two- 
digit decimal fraction. (32%) 

Division of decimal numbers 

The review panel of mathematics experts selected one objective 
from this area of mathematics as basic. The objective they 
selected requires a student to be able to divide a two-digit 
decimal fraction by a one-digit decimal fraction (60% of the 
sixth graders met this objective) . The review panel of 
mathematics teachers did not select any objectives from this 
group . 

Negative integers 

The sixth-grade students were asked to respond to. test items 
measuring four objectives dealing with negative integers. 
Both the mathematics teachers and experts agreed that the 
students should be able to 

add two one-digit negative integers. {39%) 
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Rounded numbers (estimation) 



Mathematics teachers selected one objective as basic from 
this group; the mathematics experts did not name any. The 
objective the teachers named would ask the student to use the 
process of estimation by rounding off a five-digit number to 
the nearest 10,000 (26% of the sixth graders did this). 

Identity eleme nt 

The mathematics teachers identified three of the four objec- 
tives covering identity elements as basic. The three objec- 
tives called for the student to be able to supply c» zero as 
the identity element in an unfinished mathematical sentence 
involving the addition of whole numbers (71%) , the number one 
as the identity element in an unfinished mathematical sentence 
involving the multiplication of whole numbers (56%) , and a 
zero as the identity element in an unfinished mathematical 
sentence involving the addition of positive fractions (65%) . 

Measurement 

This part of the objectives contained many everyday applica- 
tions of mathematics that asked for the student to be able to 
use a variety of measurements. The review panels selected 
many of these objectives as basic. They did not reach a con- 
sensus on all the objectives selected, but there are several 
that are common to both groups. The objectives selected as 
basic by both groups are the following: 

being able to use a ruler to measure the length 
of an object 

the ability to add lengths expressed in inches 

and then convert the sum to feet and inches 

being able to look at an illustration of a 
liquid thermometer and then specify the 
temperature 

given an illustration of money that contains 
both bills and coins, being able to count the 
total amount 



(42%) 
(31%) 

(38%) 

(58%) 
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the ability to add (61%) , subtract (62%) , and 
multiply (60%) expressed amounts of money 



given an illustration of a clock, being able 

to specify the time that is shown. (57%) 

The review panel of mathematics experts named these additional 
objectives as basic: 



given an illustration of a ruler marked off 

into half units, being able to estimate the 

length of any given object to the nearest 

half unit (42%) 

when given an arbitrary unit of length (such 

as a map scale) , being able to measure the 

length of another given object as a number 

of these units (28%) 

given a drawing of a rectangle with the 

dimensions marked, being able to compute 

the perimeter (5%) 

given a drawing of an area that has been sub- 
divided into uniform squares, being able to 
find the area of the figure as the number of 
these square units (28%) 

given a line graph, the ability to convert 

liquid measures from gallons to quarts (38%) 

the ability to divide an expressed amount 

of money, (14%) 



The panel of mathematics teachers selected as basic the objec- 
tive of being able to add quantities of time expressed as 
hours, minutes, and seconds with regrouping (12%). 



place value 



Of the eight objectives for place value, the mathematics 
teachers and experts agreed on only one objective as being 
basic to the sixth-grade level. This objective states that 
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Given the expanded form of a three-digit 
numeral, the student will write the numeral 
(Expanded notation) . 



(81%) 



The mathematics experts selected two additional objectives as 
basic for place value. These are 

Given the values of the tens' and units' 
positions of a numeral, the student will 
write the numeral. (0-999) (81%) 

The student will specify the value of any 

digit in a five-place numeral. (1,000-99,999) (43%) 

Non-metric geometry 

Both review groups selected two objectives from this part of 
the list as basic: 

being able to select a drawing that represents 
a line segment (47%) and a drawing that repre- 
sents parallel lines (41%) from a set of geo- 
metric drawings. 

Percent 

Only one of six objectives dealing with percents was considered 
to be a basic objective by both the mathematics teachers and 
experts. This objective states the following: 

the student will be able to convert a number 

written as a fraction with denominator 100 

to percent form. (Denominator of 100) (27%) 

Sets 

From the list of objectives that dealt with mathematical sets, 
the review group agreed that two of the objectives were basic. 
The two objectives are 



when given a set of less than ten elements, 

being able to count the elements (94%) 



when given a set containing whole numbers 
as elements, being able to identify all ele- 
ments that are "more than" or "less than" a 
given number. (85%) 

The mathematics experts also selected as basic an objective 
that called for being able to distinguish from two finite 
sets, the set that is the union of these sets (22%), 

Statistics 

The mathematics experts did not rate either of the two objec- 
tives dealing with statistics on the PMI as basic. However, 
mathematics teachers rated the ability to be able to compute 
an average (mean) from a set of whole numbers as basic (20%) . 
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IV. RESULTS ON A REPRESENTATIVE GROUP OF OBJECTIVES 



A sample of the objectives was taken from the total group used 
with the Prescriptive Mathematics Inventory-Level B to facili- 
tate the discussion of pupil performances on the objectives in 
more depth and to provide illustrations of analyses that can 
be used by educators to investigate the results from criterion- 
referenced information. The processes that were used to insure 
the representativeness of these objectives are described in 
Part Il-Procedures , pages 14-15 and in Appendix D. The per- 
centages of pupils mastering each of the objectives used for 
this assessment are given in Appendices E and F. 



THE SELECTED OBJECTIVES 

In this section each of the selected objectives is stated be- 
neath the general mathematics category listings. 

Explanation of the information provided with each objective 

The number to the left of each objective indicates 
where it can be located in the total list of 
objectives . 

. An asterisk by the side of the number indicates 
that the objective was selected as being basic 
by the review groups. 

The portion of the total group of sixth-grade 
students that mastered the objective is given. 

The item used to measure mastery of each objec- 
tive is given. (Items are copyrighted by CTB/ 
McGraw-Hill, Inc., and cannot be reproduced with- 
out permission of the publisher.) 

Operations on the Number Line 



1 Given a number line with units divided into fourths, the 
student will specify a given point on the line as a mixed 
number . 
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About 1/3 of the pupils mastered this objective. The students 
were asked to tell the mixed numbers that belonged at the 
point of the arrow. 



I 

— h- ^ 1— I— I l-H-^ 

2 3 4 

Subtraction of Whole Numbers 



13* The student will be able to subtract a 3-digit whole 
number from a 3-diqit whole number with regrouping. 

70% of the sixth graders were able to do the following: 

921 
-756 



15* The student will be able to subtract a 5-digit whole 
number from a 5-diqit whole number with regrouping. 

57% cf the students were able to subtract 

20,408 
-19,535 

Multiplication of Whole Numbers 



19* The student will be able to multiply a 2-digit whole 
number by a 1-digit whole number. 



Over 3/4 of the pupils were able to multiply 



Addition of Positive Fractions 



40* The student will be able to rename a fraction by reduc- 
ing the numerator and denominator to lowest terms, 

14% of the sixth-grade students were able to do the following: 

48 

Reduce to lowest terms. 

Division of Positive Fractions 

65 The student will be able to divide a proper fraction 
by a mixed number . 

1% of the pupils in the assessment could divide 

7/8 T 3 2/3 = 

Subtraction of Decimal Numbers 

78 The student will bt able to subtract a decimal number 

with 2 decimal places from another decimal number with 
2 decimal places with regrouping, 

3 7% of the students were able to subtract 

156.75 - 38.91 = 

Multiplication of Decimal Numbers 

83 The student will be able to multiply a l~digit decimal 
fraction by a 1-digit decimal fraction. 

Almost 1/3 of the sixth graders could multiply 

.3 

X .8* 
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101 The student will be able to divide a 2~digit whole 
number by a negative integer, 



40% of the students proved they could do the following: 

rivide 20 T -4 = 
Rounded Numbers (Estimation) 



102 The student will be able to round off a 5-digit number 
to the nearest 10,000, 



1/4 of the pupils were able to 

Round 27,536 off to the nearest 10,000. 
Commu tative Property 



107 Given an addition problem with two positive fractions 

as addends the student will be able to supply the 
missing factor in the commuted form of the problem, 

32% of the students were able to find the number that made 
the following mathematical sentence true: 

43 + = 9 + 
155 13 13 

inverse Relations 



lis The student will be able to supply a missing positive 

fraction in a pair of unfinished mathematical sentences 
illustrating the inverse relationship between multipli- 
cation and division. 



Slightly over 1/5 of the pupils could find the number that 
made both of the mathematical sentences true. 



123 Given a sequence of positive fractions with like de- 
nominators and with numerators progressively decreas- 
ing by a constant value, the student will be able to 

supply a missing number from the sequence, 

Over half of the sixth graders were able to supply the missing 
number from the following sequence: 

17 15 , li _9 _I 

32, 32, 32, 32, 32 

Number Theory 



131 Given a set of whole numbers, the student will be able 
to select those which are composite, 

Only 2% of the students in the assessment could choose the 
composite numbers from the following group of numbers: 



1,2,3,4,5,6,7,8,9,10,11 



Measur ement 



147* The student will be able to add expressed amounts of 
money, 

Slightly over 3/5 of the pupils could add 

$25.28 
2,05 
+46.75 



148* The student will be able to subtract expressed amounts 
of money. ^ 



62% of the students in the assessment proved they could do 
the following: 



Subtract: $5.98 
-3.72 
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Place Value 



165* Given the expanded form of a 3-digit numeral, the 
student will write the numeral, (Expanded notation) 

Over 4/5 of the pupils could write as one number 

(3x100) + (5x10) + 7 = 



Non-metric Geometry 



193 Given the scale of a map, the student will be able to 
compute the distance between any two points, 

8% of the pupils could answer the following: 

If one inch on a map represents 8 miles, then 13 
inches on the same map represents how many miles? 

Percent 



202 The student will be able to convert a number greater 

than unity written as a fraction to percent form. 
(Percents greater than 100) 

12% of the pupils showed that they could convert the following 
fraction to the correct percent form: 

14 

10 written as a percent would be %. 

Sets 



207 Given two finite sets, the student will specify the set 
that is the intersection of these sets. (Intersection) 

45% of the sixth graders did the following: 

List the elements contained in the set that is the 
intersection of sets E and F. 

E = £5,7,10,14,15,27} F = {7,8,9,13,15,22} 
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Reasoning 



212 Given a word problem requiring one or more fundamental 

operations with small whole numbers for solution, the 
students will be able to solve the problem, 




45% of the students correctly answered the following: 

If Bill is now 12 years old, and ht is now twice as 
old as his sister, then three years from now his sister 
will be years old. 



Percentages of mastery of the selected objectives - The per- 
centage of pupils mastering the selected mathematics objectives 
ranged from a high of 81% for the objective requiring the 
students to write the numeral for an expanded form of a three- 
digit numeral to a low of 2% for the objective asking the 
student to select the composite numbers from a set of whole 
numbers. 



PUPIL PERFORMANCE BY POPULATION CATEGORIES 



Figures 1 through 7 show pupil performance of various pupil 
populations on each of 21 objectives selected as representative 
of the 209 mathematics objectives. Comparable data for all 209 
measured objectives appear in tabular form as Appendix F. 

Looking at Figure 1, the percentage of pupils who mastered 
Objective #1 (identified on the bottom line of the figure) is 
seen, from the vertical scale, to be approximately 32% for 
males (M) and 27% for females (F) . The distance between M 
and F represents the difference between the percentage of males 
and the percentage of females who mastered the objective. 
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Figure 1 shows, for each of the 21 objectives chosen as repre 
sentative of all 209 objectives, the amount of difference 
between the percentage of achievers among the male and female 
pupils. On only two of the 21 objectives (#1 and #102) did a 
higher percentage of boys than girls achieve the objective. 
On none of the objectives is the difference between the sexes 
in their percentage of achievers greater than 10 percentage 
points . 
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FIGURE 1 

PERCENT OF PUPILS MASTERING SAMPLE PMI OBJECTIVES BY SEX 
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Figure 2 shows that on 13 of the 21 representative objectives, 
the percentage of achievers was at least 10 percentage points 
higher among pupils who were neither Black nor Mexican Ameri- 
can, Of the remaining eight objectives, three were achieved 
by less than 10% of all pupils; on Objective #83 and #202, the 
percentage of achievers was almost as high among the Black 
and Mexican American pupils; on Objectives #19, #118, and 
#148, the percentage of achievers was almost as high among 
the Mexican American pupils as among pupils who were neither 
Black nor Mexican American. 
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FIGURE 2 

PERCENT OF PUPILS MASTERING SAMPLE PMI OBJECTIVES BY ETHNICITY 
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Figure 3 shows that on 10 of the 21 representative objectives, 
the pupils enrolled on campuses serving suburban communities 
had the highest percentage of achievers, those on campuses 
serving cities below 200,000 population had the second high- 
est percentage of achievers, and those on campuses serving 
rural areas had the third highest percentage of achievers. 

On 15 of the 21 objectives, the pupils on campuses serving 
cities of over 500,000 population or cities of 200,000 to 
500,000 population had either the lowest or second lowest 
percentage of achievers. On Objective #207, however, pupils 
on campuses serving cities of over 500,000 population had the 
highest percentage of achievers. 



FIGURE 3 

TERCENT OF PUPILS MASTERING SAMPLE PMl OBJECTIVES BY SIZE OF COMMUNITY 
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Figure 4 shows that for only one (Objective #207) of the 21 
objectives is the difference in the percentage of achievers 
among those enrolled on Non-Title I campuses and among those 
enrolled on Title I campuses greater than seven percentage 
points . 



FIGURE 4 

PERCENT OF PUPILS MASTERING SAMPLE PMI OBJECTIVES BY FUNDING SOURCE 
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Figure 5 shows that for all except four of 21 representative 
objectives, pupils from homes where the educational emphasis 
is high had a percentage of achievers at least 10 percentage 
points greater than that of pupils from homes where the educa- 
tional emphasis was low; of the four exceptions, only Objec- 
tive #83 was achieved by over 10 percent of all pupils. Achieve- 
ment on Objectives #1, #123, and #212 is seen to be highly 
sensitive to the Educational Emphasis index. 
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HGURE 5 

PERCENT OF PUPILS MASTERING SAMPLE PMI OBJECTIVES BY EDUCATIONAL EMPHASIS INDEX 



1^ 



H High 
I. - Low 



L -L 



4- 



.L 



H 



^ ^ ^ ^ ^ ^ 83 m iSi lO? iiS 1 23 1^1 lit \a m ' m m u 

OBJECTIVE NUMBERS 



39 



Figure 5 shows that on 17 of the 21 representative objectives, 
pupils who checked "Yes" in response to the question "Are you 
good in arithmetic?" had a percentage of achievers at least 
10 points higher than pupils who checked "No." Of the remain- 
ing four objectives, three were achieved by less than 10% of 
all pupils; Objective #83 stands out as an objective on which 
pupils who did not perceive themselves as being good in arith- 
metic had almost as high a percentage of achievers as those 
who perceived themselves as being good in arithmetic. 



FIGURE 6 

PERCENT OF PUPILS MASTERING SAMPLE PMl OBJECTIVES BY SELF-PERCEPTION IN ARITH>JET1C 
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Figure 7 shows that pupils who checked "Yes" in response to 
the question "Are you good in reading?" had a higher percentage 
of achievers than pupils who checked "No." On 14 of the 21 
objectives, the difference was greater than 10 percentage 
points • 



FIGURE 7 

PERCENT OF PUPILS MASTERING SAMPLE PMI OBJECTIVES BY SELF-PERCEPTION IN READING 
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ADDITIONAL ANALYSES 



Figure 1 through Figure 7 each focused upon one characteristic 
(such as ethnicity of the pupils or type of community served by 
the pupils' campus) and presented data for all 21 representa- 
tive objectives. Figure 8 through Figure 10 reverse the focus; 
each figure presents, for a single objective, data for all 
seven pupil/campus characteristics. 

Figure' 8, 9, and 10 show for Objectives #123, #166, and #107, 
respectively, the amount toy which the performance of pupils of 
several subgroups differs from the performance level of all 
Texas pupils. The largest deviations can be seen to occur on 
the basis of ethnicity; educational emphasis also is seen to 
have a strong relationship to pupil performance. Deviations 
on the basis of sex or on the basis of whether the campus on 
which the pupils are enrolled participates in Title I, ESEA, 
are seen to be slight. 

The volume of this report would be expanded unduly if a figure 
were provided for each of the 21 representative objectives. 
The three whose data are presented as typical of the predominant 
patterns include one near the 50% level of achievement, one 
near the 80% level, and one near the 30% level. Readers can 
use the data of Appendix F to construct similar figures for 
any objectives of particular interest to them. An education 
service center could use the d^ta it has received to construct 
such charts for its region. A school might want to construct 
charts for those PMI objectives which are most related to their 
mathematics program; however, since schools were not selected 
so as to be representative of their school district, districts 
should not sum the data from their schools that participated 
in this assessment study to construct district figuias. 
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V. SUMMARY OF FINDINGS 



The PMI data were collected from a representative (10%) 
sample of Texas sixth-grade pupils according to their sex 
distribution, ethnic groups, sizes of communities in which 
their schools were located, and funding source (Title l/ Non- 
Title I schools) . 

The project was so designed that the education service centers 
and participating schools worked cooperatively in providing 
accurate information by making sure that the pupils had every 
ch£\nce to answer the questions, and by checking the pupils' 
responses on the PMI answer sheets. The length of the instruc- 
tions necessary to take or administer the PMI was kept to a 
minimum so that the pupils could spend their time on taking 
the test. The test administrators were encouraged to help 
the pupils in whatever way possible (with the exception of 
answering the questions or working the problems for them) . 
No attempt was made to determine the exact conditions under 
which these tests were administered; however, it could be 
assumed that the testing situations varied almost as much as 
the performances of the pupils (e.g., some of the school 
personnel indicated that they tested all of the sixth graders 
at the same time in the auditorium within a two-day period 
•while others had their pupils work on the test over a two-week 
period as a part of their regular classwork) . No attempt was 
made to relate the kinds of testing situations to the perfor- 
mances of the pupils on the PMI; however, very few comments on 
the teacher's evaluation survey seemed to indicate that this 
was a problem. 

An advantage of the PMI is that it is a "power-test," not a 
"time-test." It was designed specifically to measure the 
performances of every pupil no matter how much or how little 
time it took. Therefore, the PMI data should give a fairly 
accurate indication of how the pupils were able to perform 
with regard to the 209 measured objectives covered in the 
state-adopted textbooks for mathematics. Whether or not 
these pupils had been taught or had learned to achieve objec- 
tives other than those in the PMI is unknown and an area for 
further investigation . 

Considerable effort was made to eliminate any cultural bias 
in the wording of test items in the PMI* The purpose of the 
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PMI was not to discriminate against any particular pupil 
population but to determine if any of the pupils performed 
differently on the PMI, regardless of their reference groups. 
Unfortunately, time did not permit a tryout of the PMI objec- 
tives on a sample of different pupil populations. The extent 
to which the PMI data is invalid will depend upon the demonstra- 
tion of bias in the PMI test items and/or objectives derived 
from the state- adopted textbooks for mathematics at the sixth- 
grade level . 

Criteria - Setting universal standards for pupil performances 
in mathematics is difficult if not undesirable. The criteria 
for "accep'table" performance can, of course, be established 
in any number of ways: comparing the performances of pupils 
with other pupils, develrip.-i ng absolute standards of excellence, 
setting minimum levels for achievement in society, having the 
individual pupil set his own levels of performance, and so on. 
In this case, a select group of educational experts and teachers 
was asked to rate the PMI objectives as to whether they thought 
they were "basic" or "desirable" for the pupils functioning in 
society. Whether the performances of the pupils meet these 
expectations is apparent throughout this report; whether these 
are the acceptable levels of pupil performances is still an 
open question and should condition the drawing of hard-and- 
fast conclusions. 

Utility - The use, in the modification of instructional pro- 
grams, of conclusions regarding pupils' achievement of the 
objectives should occur only after consideration of such mat- 
ters as 

the degree to which the pupils have been exposed 
to the objectives 

the level of difficulty of the test items, and 

the relevance of the test item content to the 
pupils* cultural experiences. 

Related studies - The Agency is conducting two studies directed 
toward determining the relationships betv/een pupil learning and 
school based factors. The Department of Special Education and 
Special Schools has undertaken a project entitled Programmed 
Reentry Into Mainstream Education (PRIME) . Project PRIME fo- 
cuses upon the relationship between learning, on the one hand. 
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and such variables as children's personality characteristics, 
classroom social organization and climate, teacher behaviors 
and attitudes, peer relations, and home environment, on the 
other. The Division of Accreditation is undertaking a study 
of the relationships between learning and a host of variables 
such as curricular offerings, teacher qualifications, school 
expenditures, ethnic composition of the campus pupil popula- 
tion and staff, and community characteristics. 



GENERAL FINDINGS 

The percentage of pupils achieving the PMI objectives ranged 
widely-from zero in the case of four objectives (#90, #95, 
#96, and #203) to 94% for Objective #204. On only 105 of the 
objectives did the percentage of achievers fall below 30%. 
At least half the pupils achieved 47 of the 209 objectives 
that were measured. 

Pupils* performances on the PMI objectives were analyzed to 
determine the relative standL_ng of 

boys and girls 

Black, Mexican American, and other pupils 

pupils whose schools were and were not participating 
in ESEA, Title I 

pupils whose schools were located in communities 
of various sizes and types 

pupils whose educational environment at home 
was high and low 

pupils who did and who did not perceive themselves 
as good in reading 

pupils who did and who did not perceive themselves 
as good in arithmetic. 

For each of the above characteristics, the percentages of 
pupils achieving each of the 209 PMI objectives are presented 
in Appendix F, and a summary chart of the total performances 
of all the sixth graders is given in Appendix G. 
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Sex - The percentage of girls achieving the objective exceeded 
the percentage of achieving boys by at least five percentage 
points on 

86 objectives 

18 of the 21 objectives concerned with multiplica- 
tion and division of whole numbers 

10 of the 11 objectives concerned with the addi- 
tion and subtraction of decimal fractions 

all 12 of the objectives concerned with the com- 
mutative property, associative property, distribu- 
tive property, identity element, and inverse rela- 
tion. 

On only six objectives did the percentage of achievers among 
the boys exceed the percentage of achievers among the girls 
by five or more percentage points; four of these were in the 
area of measurement. 

Ethnicity - On 151 of the 153 objectives achieved by at least 
10% of the pupils, those who were neither Black nor Mexican 
American had a higher percentage achieving the objective than 
either Blacks or Mexican Americans; the exceptions were Objec- 
tives #100 and #194. On only one (#207) of these 153 objec- 
tives did the Blacks have a higher percentage of achievers 
than the Mexican Americans. 

On 78 of the 153 objectives achieved by at least 10% of all 
pupils the percentage of Black pupils achieving the objectives 
was less than half as large as the percentage achieving the 
objective among pupils who were neither Black nor Mexican 
American. 

On 2 9 of the 153 objectives achieved by at least 10% of all 
pupils, neither Black nor Mexican American pupils had half as 
large a percentage of achievers as pupils who were neither 
Black or Mexican American. Ten of these 29 objectives are 
concerned with the addition, subtraction, or multiplication 
of positive fractions; four with rounded numbers (estimation); 
three with number sequences (linear functions); six with 
measurement; three with -numeration systems; two with opera- 
tions on the number line; and one with the multiplication of 
whole numbers. 



49 



On nine of the 153 objectives achieved by at least 10% of all 
pupils the differences in performance among the three ethnic 
categories did not spread more than 10 percentage points; 
these were Objectives #56, #83, #86, #100, #174, #183, #192, 
#194, and #202. 

Pupils on Title I Campuses - On only nine of the objectives 
did the pupils from campuses not participating in Title I, 
ESEA, have a percentage of achievers more than five points larger 
than that of the pupils from campuses participating in Title I; 
on only one objective, #207, was the difference more than eight 
percentage points. 

On none of the objectives did the pupils from Title I campuses 
have a percentage of achievers more than three points larger than 
that of the pupils from campuses not participating in Title I. 

Size and type of community - For each of the objectives, the 
percentage of pupils achieving the objectives was tabulated 
for pupils on campuses serving 

suburban communities 

cities of less than 200,000 population 

rural areas 

. cities of 200,000 to 500,000 population 

cities of over 500,000 population. 

Comparison of the percentage of achievers on each of the 209 
measured objectives among the pupils on campu'ses serving each 
of the five types of communities disclosed a fairly consistent 
pattern: 

1. The pupils on campuses serving suburban com- 
munities, on all except 20 objectives, either 
had or came within three percentage points of 
having the highest percentage of achievers. 

2. The pupils on campuses serving cities of less 
than 200,000 population, on all except two 
objectives, either had or came within three 
percentage points of having the second highest 
percentage of achievers. 
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3. The pupils on campuses serving rural areas, on 
all except 13 objectives, either had or came 
within three percentage points of having the 
third highest percentage of achievers. 

4. The pupils on campuses serving cities of 200,000 

to 500,000 population, on all except 11 objectives, 
either had or came within three percentage points 
of having the fourth highest percentage of 
achievers . 

5. The pupils on campuses serving cities of over 
500,000 population, on all except 17 objectives, 
either had or came within three percentage points 
of having the lowest percentage of achievers. 

Departures from the predominant pattern indicate that campuses 
of various sizes and types differ in the emphasis which they 
place on certain objectives: 

1. On Objective #207, the pupils on campuses serving 
cities over 500,000 population had the highest 
percentage of achievers and pupils on campuses 
serving rural areas had the lowest percentage 

of achievers. 

2. On Objective #84 and Objective #87, the pupils 
on campuses serving suburban communities had 
the lowest percentage of achievers. 

3. On Objectives #111, #113, #115, #122, #146, #148, 
#154, #168, #185, and #198, the usual ranking 
obtained by campuses serving cities of 200,000 

to 500,000 population was reversed with that 
usually obtained by campuses serving cities of 
more than 500,000 population. 

4. On Objective #163 and Objective #207 the pupils 
on campuses serving rural areas had the lowest 
percentage of achievers. 

5. On Objectives #40, #41, #44, #150, #151, #154, 
#161, and #162, the pupils on campuses serving 
rural areas had the highest percentage of 
achievers . 
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6. On Objective #171, the pupils on campuses serv- 
ing cities of less than 200,000 population had 
the highest percentage of achievers and pupils 
on campuses serving cities of more than 500,000 
population had the second highest percentage of 
achievers ♦ 

7. On Objective #169, pupils on campuses serving 
cities of more than 500,000 population had the 
second highest percentage of achievers and 
pupils on campuses serving suburban communities 
had the fourth highest percentage of achievers. 

8* On Objectives #163, #169, and #171, the pupils 
on campuses serving cities of more than 500,000 
population had the second highest percentage 
of achievers. 

9. On Objective #170, pupils on campuses serving 
cities of more than 500,000 population had the 
third highest percentage of achievers and the 
pupils on suburban campuses had the fourth 
highest percentage of achievers. 

10. On Objectives #33, #35, #36, #40, #41, #44, 
#89, #150, #151, #154, #176, and #185, the 
pupils on campuses serving suburban communities 
had the third highest percentage of achievers. 

Educational emphasis in the home - For each of the 209 objec- 
tives, the percentage of pupils achieving the objective was 
tabulated for pupils from homes where educational emphasis 
was extremely high or extremely low (see page 12 for deriva- 
tion of the Educational Emphasis Index) . 

On all except seven of the 153 objectives achieved by at least 
10% of the pupils, the percentage of achievers among pupils 
from homes having a high educational emphasis was either at 
least 10 percentage points greater than among pupils from 
homes having a low educational emphasis or was at least double 
the percentage of achievers among pupils from homes having a 
low educational emphasis. The seven exceptions were 

Objective #86 (High Emphasis 14%, Low Emphasis 9%) 
Objective #100 (High Emphasis 12%, Low Emphasis 14%) 
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Objective #183 (High Emphasis 18%, Low Emphasis 12%) 

Objective #184 (High Emphasis 21%, Low Emphasis 13%) 

Objective #192 (High Emphasis 18%, Low Emphasis 11%) 

Objective #194 (High Emphasis 10%, Low Emphasis 11%) 

Objective #204 (High Emphasis 96%, Low Emphasis 91%) 

Self-perception in arithmetic - Pupils who felt they were good 
in arithmetic had a higher percentage of achievers, on all ex- 
cept five of the 209 objectives, than pupils who did not feel 
they were good in arithmetic. Three of the exceptions were 
objectives achieved by less than 2% of the pupils; the others 
were Objective #194 (which was achieved by 11% of each group) 
and Objective #100 (which was achieved by 13% of each group) . 

On 141 of the 153 objectives achieved by at least 10% of the 
pupils, the percentage of achievers among pupils who felt they 
were good in arithmetic was either at least seven percentage 
points greater than among pupils who did not feel they were 
good in arithmetic, or was at least double the percentage of 
ahcievers among pupils who did not feel they were good in 
arithmetic. On 24 of the objectives the difference was 20 per- 
centage points or greater. 

Self-perception in reading - Pupils who felt they were good 
in reading had a higher percentage of achievers, on all except 
10 of the 209 objectives, than pupils who did not feel they 
were good in reading; all of the 10 exceptions were objectives 
achieved by less than 2% of the pupils. 

On 137 of the 153 objectives achieved by at least 10% of the 
pupils, the percentage of achievers among pupils who felt they 
were good in reading was at least seven percentage points 
greater than among pupils who did not feel they were good in 
reading. 

Recapitulation - Approximately one quarter of the 209 objectives 
were achieved by at least half the pupils and another quarter 
by less than 10% of the pupils. 

The following statements apply for the 153 objectives achieved 
by at least 10% of the pupils: 

1. On a little over half of these objectives the girls 
had a substantially higher (i.e., at least four 
points) percentage of achievers than the boys. 
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2. 



On over 95% of these objectives 



Others (primarily Anglos) had a higher per- 
centage of achievers than Mexican Americans, 
and 

Mexican Americans had a higher percentage 
of achievers than Blacks. 

3. The percentage of achievers among the Others 
was 

on half of these objectives, double the 
percentage of achievers among the Blacks 

on a fifth of these objectives, double the 
percentage of achievers among the Mexican 
Americans . 

4. On about 90% of these objectives the percentage 
of achievers was substantially higher among 
pupils who responded affirmatively to the ques- 
tions: "Do you feel you are good in arithmetic?" 
or "Do you feel you are good in reading?" 

The superior performance of the girls over the boys is strong- 
est in three areas: 

multiplication and division of whole numbers 

addition and subtraction of decimal fractions, and 

properties of the number system. 

On only nine of the objectives did the pupils on campuses not 
participating in Title I, ESEA, obtain substantially higher 
(five or more points) percentages of achievement than pupils 
on campuses which are participating in Title i. 

On most of the objectives the pupils on campuses serving 

suburban communities had the highest percentage 
of achievers 
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cities of less than 200,000 population had the 
second highest percentage of achievers 

rural areas had the third highest percentage 
of achievers 

. cities of 200,000 to 500,000 population had 

the fourth highest percentage of achievers, and 

cities of over 500,000 had the lowest percentage 
of achievers. 

Substantial departures from the above pattern of relative 
performance among pupils on campuses serving communities o 
various sizes and types were observed in the cases of 38 
objectives . 



VI. USE OF ASSESSMENT INFORMATION 



Teachers whose pupils were tested have received reports of the 
performance on each of the objectives by each individual 
pupil; in addition, the teachers and principals have received 
summary reports by classroom and by campus. The sample was 
not designed to provide superintendents with a representation 
of performance by school districts. The campuses selected to 
contribute to the representation of each education service 
center region and, in total, the State of Texas, were not 
necessarily representative of the school district from which 
they were drawn. 

The information in this statewide report is appropriate f 
use by curriculum directors, mathematics supervisors, ar " 
other district level personnel having responsibility for 
planning, developing, and implementing programs for students. 



MZ^ING USE OF THE ASSESSMENT INFORMATION 

Review of the objectives - The objectives for the Prescriptive 
Mathematics Inventory-Level B which was used as the assessment 
instrument for this study are based on mathematics skills and 
concepts taught in most classrooms through the sixth-grade 
level. They were derived from an analysis of the major series 
of textbooks that are used in schools, including those on the 
state-adoption list in Texas. 

A beginning point in making use of the results is to srudy 
the PMI objectives and note the ones that are relevant to the 
district's mathematics program. If the school district's 
mathematics program objectives have not been specified, a 
good reference is the set of objectives found in curriculum 
guides or in the charts available with the mathematics toxt- » 
book series in use in the district. In all probability there 
will not be a complete congruence between the PMI's objectives 
and the school's objectives. Also, in reviewing the objectives, 
note those that have been designated as "basic" by statewide 
evaluation groups. 

If the district does not have program objectives for the 
mathematics curriculum, the objectives used with the PMI 
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could be of assistance in developing these. The objectives 
that are developed by the district can serve to point direc-- 
tions for instruction and can communicate progress in student 
performances. The incorporation of "basic" objectives into 
the district's overall program objectives could provide a 
start for the development of some type of minimum level for 
students to reach to operate as consumers in society. 

Determining pupil performances - The results from this state- 
wide mathematics study, because of sampling procedures used, 
would not present a true picture of pupil performance for 
each school district that participated in the mathematics 
assessment. The state sample purposely includes a certain 
percentage of different student populations that is repre- 
sentative of Tex^s. However, with the use of the objectives 
for the mathematics program, information similar to that in 
the assessment study can be developed by school districts. 
Several alternatives can be used. 

Some concepts about the status of students can be derived 
from studying the reports provided for schools through this 
assessment. Direct statements about district level of per- 
formances cannot be made but some general perceptions about 
students in relation to the objectives can be made. If the 
objectives that are included in the district's mathematics 
program have been noted, the educators at the district level 
can later investigate any discrepancies between what might be 
expected as the performance and the actual performance. 

Another alternative for determining pupil performance in rela- 
tion to learner objectives for the mathematics program at the 
district level v/culd be to administer a criterion-referenced 
test instrument as a part of the school district's testing 
program. However, careful preliminary planning must be done 
if assessmeiit information such as that gained in the state- 
wide study is to be gathered. For instance, a grade level 
for assessment has to be chosen. Plans have to be made for 
collecting demographic information about the student popula- 
tion groups and for relating this information to student 
performances. If the assessment is going to be based on a 
sample of students, then the sampling plan must be developed. 
Because of the type of information that is required for a 
district-wide assessment, it is probable that computer services 
will be necessary. If the alternative of conducting a district 
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assessment similar to the statewide mathematics assessment is 
chosen, a review of the procedures used for the 1971 Texas 
Assessment of Reading and Mathematics would be helpful. 

Summarizing the results - The information about student per- 
formances on the statewide assessment of mathematics and the 
emphasis in this section on transferring some of the concepts 
from this assessment for use in school districts is based on 
the use of criterion-referenced instruments for assessment. 

The results of criterion-referenced instruments have to be 
treated differently from those received from standardized 
tests that most school personnel are accustomed to using. 
This difference is due primarily to the psychometric procedures 
used in developing the two different types of instruments. 
Criterion-referenced tests are intended for determining the 
relationship between measurable objectives and student per- 
formances relative to mastery of these objectives, while 
standardized (norm-referenced) types of tests are intended 
to find out about the* abilities of students by comparing them 
with other students. Because of the importance of the objec- 
tives in cr iter ion-referenced testing, group reports of results 
are stated by giving the percentage of pupils who mastered 
each objective. These results cannot be summed into a single 
performance score as in the case of norm-referenced test re- 
sults . 

Application of assessment results - As was mentioned in the 
section on determining pupil performances, a school district 
will be interested in the relationship between expectations 
for performance and the actual performances of students. Some 
considerations should be taken into account in setting the 
expectation levels. These are the degree of difficulty of the 
performance expressed in the objective, the amount of previous 
instruction that the students h ve had in the subject matter 
covered by the objective, and tue grade level or educational 
level of the students. A review of student performances should 
include notations of any discr pancies . For example, school 
personnel may have set an expectancy level that 50% of the dis- 
trict's students upon entering the sixth grade had mastered the 
objective of being ablo to add like fractions with regrouping. 
If the sixth graders* performance on the assessment revealed that 
30% of these students mastered this objective, then the 20% dis- 
crepancy on this objective would be noted for investigation. 
These discrepancies can then be organized into statements that 
express the needs of learners in the mathematics program. 



58 



Before an investigation of causative factors is initiated the 
assessment information should be validated, particularly if 
it was derived from one test instrument that was administered 
once during the school year. One method of validation would 
be for teachers to readminister items related to objectives 
that the assessment indicated students were having difficulty 
in mastering. After validations, causative factors for the 
remaining discrepancies might be investigated from several 
points of view. Several approaches might be taken. 

A study could be made of the instructional materials used 
by the schools in the district. Perhaps the instructional 
materials in use, such as the basic text, do not emphcsize 
the skills and concepts covered in some of the objectives. 
If certain student population groups are showing discrepan- 
cies on a large number of mathematics objectives, the entire 
range of instructional materials might be studied to deter- 
mine the problem with current materials and to identify dif- 
ferent and alternative instructional materials that might 
hold more relevance for pupils from various environmental 
backgrounds . 

The instructional techniques used in the classroom could be 
investigated if gross discrepancies have been revealed. If 
the predominant instructional pattern used in the school is 
group oriented, the assessment information might indicate that 
many of the students have not had sufficient time and explana- 
tion to master the ideas stated by the objectives. Organiza- 
tion for instruction might be changed because of the informa- 
tion provided by the assessment. 

Many more investigations can be initiated from an analysis of 
assessment data that have not been covered in this report. 
For instance, such possible causation factors as teacher atti- 
tudes, parental and community attitudes, and student motiva- 
tional factors might be studied. 

Making use of all the information from an assessment study is 
like opening "Pandora's box." Studying the data from differ- 
ing frames of reference can produce a variety of investigations 
and a variety of interpretations. For a school district with 
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limited time and resources, the statements of student needs 
that are derived from the assessment information will have to 
be prioritized and plans will have to be developed for a 
series of phases directed towards alleviation of the needs. 

A thorough report on the usefulness of the information from 
the 1971 study and adaptation of assessment concepts by a 
school district would be quite lengthy. However, school dis- 
tricts can contact the Texas Education Agency or their re- 
gional education service center for more information about 
utilization of the results of the 1971 Texas Assessment of 
Mathematics, or needs assessment in general. 
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VII. EVALUATION 



An essential part of the assessment project was its evaluation 
phase. Evaluative information was requested from teachers and 
other school personnel to determine 

the degree to which school personnel are familiar 
with the concepts of criterion-referenced tests 

the teachers* perceptions about the usefulness of 
criterion-referenced information in the classroom, 
and 

the degree to which the present system of com- 
munication about assessment projects is providing 
information for the classroom teacher • 

An independent consultant assisted the Texas Education Agency 
in the development of four separate instruments for evaluation 
purposes. These were: 

1. Survey Form for School Contact Persons - These 
were designed for use by the assessment contact 
persons in the education service centers to 
determine the extent to which school personnel 
were knowledgeable about and used criterion- 
referenced tests. 

2. Survey of Teacher Opinion I - These were designed 
to record the initial reactions of sixth-grade 
mathematics teachers to the assessment procedures 

and instruments used (after they had been administered 
but before the results had been returned to the 
schools) . 

3. Evaluation Form-Post-Test Workshop - Workshops were 
held in each of the education service centers to 
review the test results and to discuss how the 
information could be used in classroom instruction. 
This evaluation form was used to find out how well 
school personnel thought the objectives for the 
post-test workshops were met. 



61 



4, Survey of Teacher Opinion II - These questionnaires 
were designed for sixth-grade mathematics teachers 
to express their reactions to the total assessment 
effort after most of them had the opportunity to 
study and use the results. 

A brief summary of the responses to each individual evaluation 
instrument is presented in Appendix H. The following conclu- 
sions can be drawn from these evaluation summaries: 



!• Criterion-referenced testing was a new experience for over 
90% of the school personnel. 

2. The teachers surveyed agreed that the testing was 

(a) based on measurable objectives, (b) primarily for 
diagnostic or planning purposes, and (c) more useful 
as a diagnostic tool than norm-referenced tests for 
pupil appraisal. 

3. Since school personnel agreed with the concepts of 
criterion-referenced testing, but were not sure that 
they could explain the principles involved to another 
teacher, perhaps they have not had enough experience 
with this type of testing to really understand the 
implications . 

4. The evaluative questionnaires used to collect informa- 
tion showed that the respondents were very positive in 
their opinions, and that the results from criterion- 
referenced testing would be useful for planning class- 
room instruction and for tailoring programs to the 
continuous progress of pupils in the participants' 
schools . 

5. An analysis of the comments from teachers who responded 
"No" to the inquiry about the usefulness of results in 
the classroom on the "Survey of Teacher Opinion II", 
reflected concern for the following: 

The lateness in arrival of the results did not 
give enough time to make full use of the informa- 
tion about pupils during the remainder of this school 
year. (The results were late because of technical 
problems encountered by the test contractor in scor- 
ing the results.) 
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The subject-matter covered in class was not covered 
on the tests or some of the items on the tests were 
not to be covered in the teachers* classrooms. 

The test results were not applicable to the teachers* 
classroom situations, for instance the classes were 
too large to permit individualization of instruction. 

The tests were too difficult for some of the pupils. 

Not enough textbook references were given with the 
test references. 

The validity of the concepts upon which the 
criterion-referenced tests were developed was 
not challenged. 

6. Affirmative comments about the usefulness of the 

criterion-referenced results in the classroom emphasized 
the fact that the information identified pupil weaknesses 
in skills, identified areas of the curriculum needing 
study, and identified special pupil abilities. 

A majority of the teachers found the test results use- 
ful especially if they or their school had interest in 
some system of continuous progress of pupils and if 
they understood the diagnostic and planning concepts 
upon which the criterion-referenced test results were 
based. 

8. It is also evident that some of the teachers are so 
oriented toward norm-referenced comparisons of pupils 
and classroom achievement that they did not see the 
purpose in having objectives and items for the tests 
that had not been covered in the classroom. 

9. A question on the "Survey of Teacher Opinion II" asked 
about the helpfulness of the post-test workshop. The 
Survey responses of teachers who did not attend a work- 
shop differed from those teachers who did attend, in 
terms of opinions about the usefulness of test results 
for classroom instruction. For instance, 48% of the 
respondents who indicated they did not attend a workshop 
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stated that the test results were not particularly 
helpful for classroom instruction while 38% of those 
who attended workshops gave the same response. 

The voluntary participation of the regional education 
service centers and schools selected in the assessment 
study was excellent. Each of the 20 education service 
centers and almost all of the schools that were selected 
cooperated in this study. 
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APPENDIX A 



LONG-RANGE PUNS FOR NEEDS ASSESSMENT 



An increasing demand for accoimtability of public school education 
has resulted in the assessment and evaluation of educational pro- 
grams in Texas to determine the extent to which they are meeting 
the needs of learners. The underlying assumption is that these 
programs can be designed more adequately when the educational needs 
of learners have been identified. The Texas Education Agency has 
placed considerable emphasis on needs assessment as an integral part 
of comprehensive planning in Texas, 

Long-range plans for educational needs assessment are based upon 
the idea that the Texas Education Agency will initiate needs assess- 
ment activities concommitantly with the regional education service 
centers and schools. Each statewide assessment activity proposed 
(or completed) deals with (a) a specific area of concern, (b) tar- 
get populations, and (c) period of time. Although the assessment 
activities vaiy from year to year, these dimensions are useful 
for long-range planning of assessment activities. 

The areas of concern in which the Texas Education Agency has long- 
range plans for needs assessment are: 

1, Status of needs assessment and priorities among learner 
needs in Texas public schools 

2, Academic preparation of seniors for college and seniors* 
evaluation/aspiration of school and work 

3, Intellectual discipline — status of pupils in reading 
and mathematics 

4» Career Education 

5, Personal and social relations — affective behavior 

6, Learner behaviors chosen as other areas of concern , 

Each assessment area may undergo four different phases of development 
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PHASE I: 



Planning-Context Feasibility — to determine 
whether it is possible or practical to conduct 
needs assessment in a given area of concern. 



PHASE II: Pilot Testing — to determine the utility of needs 
assessment in a given area of concern. 

PHASE III: Operational Assessment — statewide assessment of 
the given area of concern. 

PHASE IV: Statewide Application — decision-making about 
elementary and secondary education system 
revisions based on assessment results. 

Each year the needs assessment activities vri.ll culminate in the 
identification of critical learner needs and provide (new) baseline 
data for the reassessment cycle. As additional areas of concern are 
identified, the activities in the Long- Range Plan for Educational 
Needs Assessment will be modified. This long-range plan is designed 
in such a way that educators will receive timely information for 
comprehens^' ve planning of educational programs based on identified 
educational needs of learners. 

The accompanying chai^ shows the framework for statewide educational 
plarming. Steps which are involved follow: 

Step Description 

1 Overall Context Scanning is the function of investigating 
the environment in which education must operate in the 
next few years; includes forecasting and identification 
of trends and counter-trends. 

2 Goals for Public School Education in Texas (GPSET ^ were 
adopted in October 1970; annual review is based on 
evaluative findings and context scanning results. 

3 Areas of Concern are selected from the goals for pri- 
ority attention by management since every area of 
education cannot be dealt with similtaneously. 

4 Study Questions are developed for each area of concern 
selected in order to guide the collection of relevant 
information upon which decisions will be made concerning 
future action. 
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■er!c1 



step 



Description 



5 Learner Needs are identified as a result of needs assess- 
ment stxidies using the study questions as a guide for 
information collection; needs are defined as the dis- 
crepancies between current status and desired conditions. 

6 Statewide Learner Objectives are established by the Texas 

V Education Agency (TEA) in partnership with school districts, 

regional education service centers, colleges and universities, 

and other interested groups; these learner objectives are 

a portion of the objectives sought by Texas school districts, 

7 Causes of Needs are determined to provide a basis for 
developing strategies to alleviate the needs. 

8 General Statewide Strategies are selected to move 
toward desired conditions. 

9 Statewide System Objectives are organizational objectives 
(not pupil objectives) which when achieved should con- 
tribute to the attainment of the statewide learner ob- 
jectives. The Agency, school districts, education 
service centers and other educational organizations in 
Texas could have a set of objectives focused on an 
identified set of learner needs. 

10 TEA Division Objectives are designed to unify the efforts 
of the organization and to apportion the work to the 
various administrative units. 

11 TEA Division Work Plans are developed to accomplish the 
Agency* s part of the statewide system objectives. 

12 Evaluation is concerned with measuring the attainment of 
learner, system, and TEA division objectives. As 
indicated, feedback loops se^^ve for renewal of goals, 
needs assessments, and learner objectives. 
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APPENDIX B 



1971 Texas Assessment of Reading and Mathematics 
PUPIL IDENTIFICATION FORM 

NAME (PLEASE PRINT) ~ " TEACHER'S LAST NAME 

SCHOOL NAME REGION SCHOOL CODE NUMBER 



PLFASE CHECK (V) YOUR ANSWERS TO THE FOLLOWING QUESTIONS. 

1. Am I in a migrant program in a migrant school? (1) □ No (2) □ Yes 

2. To which group do I belong? 

(1) □ Mexican-American (2) □ Other Spanish-surnamed American 

(3) □ American Indian (4) □ Oriental (5) □ Negro (6) □ Other 

3. Have I been in a Special Education Program? (Read all the sentences and choose the one that fits 
you best.) 

(1) □ I have not been in a Special Education Program at any time. 

(2) □ I am not in one now, but I have been in a program before. 

(3) □ I am in a program now, but I have not been in one before. 

(4) □ I am in a program now, and I have been in one before. 



4. Outside of school, how long do I usually watch TV on each school day? 

(1) □ None (2) □ lor 2 hours (3) □ 3 or 4 hours (4) □ 6 or 6 hours 
(5) □ More than 6 hours 

5. Ami a good reader? (1) □ No (2) □ Yes 

6. Am I good in arithmetic? (1) □ No (2) □ Yes 

7. Do I read books for fun, even when they are not for school? (1 ) □ No (2) □ Yes 

8. How many books do we have at home? (Read all the sentences and ohoose the one that fits you 
best) 

(1) □ We have no encyclopedias and less than 25 other books. 

(2) □ We have no encyclopedias, but we have 25 or more other books. 

(3) □ We have some encyclopedias and /ess than 25 other books. 

(4) n We have some encyclopedias and 25 or more other books. 

9. Do we get a daily newspaper, or magazines in the mail? (Read all the sentences and choose the 
one that fits you best.) 

(1) □ We get no newspapers and no magazines. 

(2) □ We get no newspapers, but we get magazines. 

(3) □ We get no magazines, but we get a daily newspaper. 

(4) □ We get magazines and a daily newspaper. 
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APPENDIX C 



COMPARISON OF REGIONAL POPUUTIONS AND SAMPLES 
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APPENDIX D 



PROCEDURES USED FOR ESTABLISHING 
THE REPRESENTATIVEIffiSS OF OBJECTIVES 



Step 1 - Converting percentage values to x-values 

For purposes of reporting, a score is given v-hich is the percentage 
of persons mastering an objective. To establish representativeness 
this percentage is converted to another niomber that maintains the same 
proportionate value as the percentage and can be added and subtracted 
with mathematical accuracy. The percentage scores (P) are changed to^ 
"x-values," and the following formula is used for making this transition. 

X = 20 arcsin y/^ - 15*71 

Step 2 - Establishing the degree of differences for factors 

The following factors were used in the study: 

FACTORS 

A. ESEA-I fvmding 

B. Ethnicity 

C. Size of community 

D . Gender 

E. Perception of self in reading 

F. Perception of self in arithmetic 

G. Educational emphasis index 

After preliminary study of the results the following decisions were made 
about each variable within a factor as to whether the genera] trend of 
scores would be in a positive or negative direction from the •'iotal score. 
The variables are listed with the decision about the direction of score 
given as a (+), (-)t neutral (o). 

VARIABLT^^S 

x^ - Total score (used as a constant) 



A- 



2 = Non-Title I + 
x^ = Title I 
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lEKICl 




X, = Other + 
4 

X- = Black 

X ^= Mexican American 



^7 = 


Over 500,000 population 




^8 = 


200,000 - 500,000 population 




^9 = 


Under 200,000 population 




^10== 


Suburb 




^0 = 


Rural 


0 



D - 



x^= F^ale + 
^12" ^^^^ 



^13^ Good in reading 
x^= Not good in reading 



F - 



x--= Good in arithmetic + 
I? 

x^^=: Not good in arithmetic 



G 



x^^= High educational environment + 
x^g= Low educational environment - 



The following formulas were used to establish the degree of sensitivity 
for each factors 

[Funding] 



— x^ ^ x^ + x^ "~ ^2 ^3 



[Ethnicity] 



74 



[Size of Conimvinity] 

Y^, = (x^ - x^) + (x^ - Xg) + (x^ - x^) + (x^Q - x^) 
= x^ - x^ + x^ - Xg + Xg - x^ +x^Q - x^ 

[Gender] 

= - ^12^ ^ (^11 - ^1^ = ^11 - ^12 
[Self Perception - Reading] 

[Self Perception - Mathematics] 

[Bducationa] Ehiphasis] 



To determine the general sensitivity of each objective the individual 
sensitivities were incorporated into the following formula • 

Y = total sensitivity score for objective 

I = + yg + Yc - yo yQ 

or 

Y = - + X^ - X^ - X^ + X^ + X^Q - X^ - Xg + x^ - x^ + x^^ - x^ + 

After the Y scores were obtained, each objective was arranged in order 
according to this score. 
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APPENDIX E 



LIST OF OBJECTIVES AND COMPARISONS OF RATINGS 
OF THE PRESCRIPTIVE MATHEMATICS INVENTORY - LEVEL B 
BY TEACHERS AND EXPERTS IN MATHEMATICS 



Explanation — Each objective was rated by both teachers and mathematics 
expertr according to these characteristics: 

All - The objective is appropriate for mastery by all sixth-grade 

pupils or their equivalent (children usually eleven to twelve 
years of age). Objectives in this category are operationally 
defined as "basic" in this report. 
- The objective is appropriate for mastery by many sixth-grade 
pupils or their equivalent. It is desirable for continuance 
in education but not basic. 
Few - The objective is appropriate for mastery by few sixth-grade 
pupils or their equivalent — probably those headed for mathe- 
matically oriented programs. 
The consensus classification for each objective by each group was derived 
by first weighting the responses, i.e. 1 for the "All" classification, 
2 for "Many," and a 3 for "Few," and then calculating a mean of the 
weights given each objective. An objective was placed in the "All" (basic) 
category if its mean was 1.5 or less, in the "Many^' category if it had 
a meai. of 1.5 to 2.5, and in the "Few" :;ategory if it received a mean 
rating above 2.5. 

The third column gives the percentages of sixth-grade students who 
mastered each Prescriptive Mathematics Inventory - Level B objective. 

Rating Rating % of students 
by by mastering each 
Teachers "Experts" obiective 

Operations on the Number Line 

1. Given a number line with units 
divided into fourths, the stude.it 
w^.ll specify a given point on the 
1 -3 as a mixed number. (Concept 

question) Many All 30fc 

•^2. Given a number line showing the 
operation of addition of whole 
numbers and an appropriate open 
mathematical sentence, the student 
will complete the mathematical 

sentence to describe the operation. All Alx k9fo 

-^Basic Objective 
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Rating 
by 



Teachers 



Rating 

by 
"Experts' 



% of students 
mastering each 
ob.iective 



Operations on the Number Line continued 

3. Given a number line showing the 
operation of subtraction of whole 
numbers and an appropriate open 
mathematical sentence, the stu- 
dent will complete the mathe- 
matical sentence to describe the 

ope rat ion. Many A 11 42^ 

4« Given a number line showing the 
operation of addition of mixed 
numbers and an appropriate open 

mathematical sentence, the stu- • ' 

dent will complete the mathematical 

sentence to describe the operation. Many All Bfo 

5. Given a number line showing the 
operation of subtraction of mixed 
numbers and an appropriate open 
mathematical sentence, the stu- 
dent will complete the mathe- 
matical sentence to describe the 

operation. Many All 10^ 

6. Given a number line showing the 
oparation of multiplication of 
mixed numbers and an appropriate 
open mathematical sentence, the 
student will complete the 
mathematical sentence to de- 
scribe the operation. Man/ All 5^ 

?• Given a number line showing the 
operation of division of mixed 
numbers and an appropriate open 
mathematical sentence, the stu- 
dent will complete the mathemati- 
cal sentence to describe the 

operation. Many Many lA 



IB 



Rating Rating % of students 

by by mastering each 
Teachers "Experts" ob.jective 



Operations on the Number Line continued 

8. Given a number line showing posi- 
tive and negative integers, the 
student will specify a given 
point on the line as negative 

integer. Few Many 2% 

Addition of Whole Numbers 

^ 9. The student wjli be able to add 
/t-digit v/hole numbers with 

regrouping. All All 

* 10. The student \^dll be able to add 

5-digit whole numbers with 

regrouping. All All 

* 11. The student will be able to add 

a column of 5 or fewer 3-digit 

whole numbers with regrouping. All All 

Subtraction of Whole Numbers 

^12. The student will be able to 

subtract a 2-<iigit whole number 
from a 2-digit v/hole number with 

regrouping. All All 

^ 13. The student w^.ll be able to sub- 
tract a 3-'-iigit v;hole number 

- x-rGf?^ a 3-<iigit -v^'hclc nunibe-r-v.*ith - - ^ 

regrouping. All All 7(^ 

^ 14« The student will be able to sub- 
tract a 4-<iigit whole number 
from a 4*-digit whole number with 

regrouping. All All 

* 15. The student will be able to sub- 

tract a 5~<iigit whole number from 
a 5-digit whole number with re- 
grouping. All All 5'}^ 
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Rating Rating $ of students 

by by mastering each 
Te ache rs "Expe rt s" ob .je ct ive 



Multiplication of Whole Numbers 

16 • The student will be able to write 
a given repeated addition problerr 
as a multiplication problem and 
compute the answer* 

17* The student v/ill be able to find 
the total number of elements in 
a rectangular array by using 
multiplication. 

^ 18» The student will be able to mul- 
tiply a l~digit whole number by 
a 1-digit whole number ♦ (Basic 
facts). 

*19. The student v/ill be ablu to 

multiply a 2-digit whole number 
by a 1-digit whole number. 

*20. The student will be abDe to 

multiply a 3-<iigit whole number 
by a 1-digit whole number. 

*21. The student v/ill be able to 
multiply a 4-di2it whole 
nuF.be r by a 1-digit whole 
number. 

22. The student will be able to 
multiply a 2-digit whole 
- nambor by a 2-digit whole - ■ 
number. 

23* The student will be able to 
multiply a 3-digit whole 
number by a 2-digit whole 
number. 

24. The student will be able to 
multiply a 3-<iigit whole 
number by a 3-<ligit whole 
number. 



All All 4^, 

All All 82/o 

All All 66^ 

All All 

All All 6^0 

All All 53^ 

Man/ All 59^ 

Many All 4C^, 

Many All 32^ 



Rating Rating % of students 

by by mastering each 

Te ache rs "Expe rb s" ob.j e ct ive 



Multiplication of Whole Numbers continued 

25. The student will be able to mul- 
tiply a 4-digit whole number by 

a 3-digit whole number. Many Many 

26. The student will identify the 
number of zeros after a single 
digit that are appropriate to 
represent multiplication of 
that digit by a given power of 

ten. Many Many 68fo 

27. Given a 2-digit whole number 
with' an exponent of 2 , the 
student will multiply the 

number by itself. Many Many lOfo 

Division of Whole Numbers 

28. The student will be able to 
divide a 2-digit whole number 
by a 1-digit whole number with 

no remainder. (Basic facts) All All Ijfo 

29. The student will be able to 
divide a 3-<ligit whole number 
by a 1-digit whole number with 

no remainder. All All 41^ 

30. The student will be able 1 
divide a 2-digit whole number 
by a 1-digit whole number with 

remainder. All ' " All 58^ 

j^i. The student will be able to 
divide a 3-^igit whole number 
by a 1-digit whole number with 

remainder. All All 55^ 

32. The student will be able to 
divide a 2-digit whole number 
by a 2-digit whole number 

with remainder. Many All 



*4^he test item did not measure the 
objective . 
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Rating Rat ing % of students 

by by mastering each 
Teachers "Experts" objective 



Division of Whole Numbers continued 

■^33 • The student vd.ll be able to divide 
a 3-digit whole number by a 2- 

digit whole number with remainder. All All 32^ 

^34« The student will be able to divide 
a 4-digit whole number by a 1- 

digit whole number with remainder. All All 32% 

35. The student will be able to div- 
ide a 4-digit v/hole number by a 
2-digit whole niomber with re- 
mainder. Many All 33^ 

36. The student will be able to 
divide a 5-digit whole number 
by a 2-digit whole number with 

remainder. Many Many 3jfo 

37* The student will represent the 

quotient as a power of ten when a 
multiplcj of a pov'er of ten is 
divided by its factor that is 

not a pov/er of ten. Few Many 6l^ 

Addition of Positive Fractions 

^3S« Given a rectangle that has been 
divided into a number of equal 
squares of which some are 
shaded, the student will speci- 
fy ""^he fractional part of the 
rectangle that is shaded. 

(Pictorial fractions) All All 3Sfo 

39. The student will convert a 
fraction expressed in lowest 
terms into higher terms. 

(Equivalence) Many All 2Ufo 

•^40. The student will be able to 

rename a fraction cy reducing 
the numerator and deiiominat'/Or 

to lowest terms. All All 14^ 
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Rating Rating % of students 

by by mastering each 
Teachers "Experts" objective 



Addition of Positive Fractions continued 

41* The student will be able to add 
3 like fractions vdthout re- 
grouping. All 

A2. The student i^rill be able to add 
2 unlike fractions wichout re- 
grouping. Many 

43 • The student vo.ll be able to add 2 

mixed numbers without regrouping. Many 

44« The student vri.?-l be able to add 2 

like fractions ;;ith regrouping. All 

45 • The student vo.ll be able to add 3 

unlike fractions vdth regrouping. Many 



46. The student will be able to add 
2 mixed numbers with regrouping* 

Subtraction of Positive Fractions 

^ WU The student vo.ll be able to 

subtract like fractions with- 
out regrouping. 

48. The student vo.ll be able to 
subtract unlike fractions 
without regrouping. 

49. The student will be able to 
subtract mixed numbers vdthout 
regrouping. 

* 50. The student v/ill be able to 
subtract like fractions vdth 
regrouping. 

51. The student will be able to 
subtract mixed numbers v/ith 
regrouping. 



Many 



All 



Many 



Many 



All 



Many 



All 

All 
All 
All 

Many 
Many 



2kio 



All 



All 



Many 



All 



Many 



13fo 



7fo 
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Rating Rating % of students 

by by mastering each 
Teachers "Experts" ob.iective 



Multiplication of Positive Fractions 



52, Given three numbers, the student 
will find the greatest common 
factor. Many 

53* iiven 3 numbers, the student 
will find the least common 
multiple. Many 

54* Given 4 fractions, the student 
will find the lowest common 
denominator. Many 

55* The student will be able to 
multiply a proper fraction by 
a proper fraction. Many 

56, The student will be able to 
multiply a whole number by a 

proper fraction. Many 

57, The student will be able to 
multiply a whole number by a 

mixed number. Many 

58, The student will be able to mul- 
tiply a proper fraction by a 

mixed number. Many 

59, The student will be able to 
multiply a mixed number by a 

mixed number. Many 

Division of Positive Fractions 

60, The student will be able to 
divide a proper fraction by a 

proper fraction. Many 

61, The student will be able to 
divide a whole number by a 

proper fraction. Many 



Many 



Many 



Many 



All 



All 



All 



Many 



Many 



22^0 
10^ 



All 



All 
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rating Rating % of students 
by by mastering each 
Teachers "Experts" objective 



Division of Positive Fractions continued 



62. The student will be able to 
divide a proper fraction by a 
whole number. 

63. The student will be able to 
divide a whole number by a 
mixed number. 

64. The student will be able to 
divide a mixed number by a 
whole number. 

65. The student will be able to di- 
vide a proper fraction by a 
mixed number. 

66. The student will be able to 
divide a mixed number by 

a proper fraction. 

67* The student will be able to 
divide a mixed number by 
a mixed number. 

Addition of Decimal Numbers 

68. The student will be able to 
convert a proper fraction to a 
decimal fraction. (Equivalence) 

69. The student will be able to add 
2 dec. fractions each with 1 
dec. place without regrouping. 

70. The student will be able to 
add 2 dec. fractions each with 

2 dec. places without re- 
grouping. 

71. The student will be able to 
add 2 dec. fractions each with 

3 dec. places without re- 
grouping. 



Many Many 1^ 

Many Many 1^ 

Many Many 1^ 

Many Many ]^ 

Many Many 1^ 

i4any Many 1^ 

Many All jjo 

Many All 6'}^ 

Many All 63/0 

Many All 
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Rating Rating % of students 

by by mastering each 
Teachers "Experts" objective 



Addition of Decimal Numbers continued 



72. The student will be able to 

add 2 dec. fractions each with 

1 dec. place with regrouping. Many 

73* The student will be able to add 

2 dec. numbers each wdth 2 dec, 

places with regrouping. Many 

74* The student will be able to 

add 2 dec. fractions each with 

3 dec. places with regrouping. Many 

Subtraction of Decimal Numbers 

^75- The student will be able to 

subtract a 1-digit dec. frac- 
tion from a 1-digit dec. 
fraction without regrouping. All 

76. The student will be able to 
subtract a 2-digit dec. fraction 
from a 2-digit dec. fraction 

wit h out re g rouping • Many 

77. The student will be able to sub- 
tract a 1-digit dec. fraction 
fron a dec. number with 1-dec. 

place with regrouping. Many 

78. The student will be able to 
subtract a dec. number with 
2 dec. places from another 
dec, number with 2 dec. places 

with regrouping. Many 

79. The student will be able to 
subtract a 3-d±g±t dec. fraction 
from a 3-<ligit dec. fraction 

with regrouping. Many 



All 



All 



Many 



k&fo 



57fo 



All 



72/0 



All 



All 



I0fo 



All 



Many 



37fo 



"The test item did not measure the 
objective. 
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Rating Rating 

By by 
Te ache r s "Expe rt s" 



$ of Students 
mastering each 
objective 



Multiplication of Decimal Numbers 

80. The student will be able to 

multiply a 2-digit whole number 
by a l~digit dec. fraction. 

81* The student v/ill be able to 

multiply a 2-digit whole number 
by a 2-di2ib dec. fra^.tion. 

82. Tiie e^tudent will be able to 
multiply a 3-digit dec. fraction 
by a 2-digit whole number. 

83. The student will be able to 
multiply a 1-digit dec. fraction 
by a 1-digit dec. fraction. 

84- The student will be able to 

multiply a 2-digit dec. fraction 
by a Inligit dec. fraction. 

85. The student will be able to 
multiply a 2-digit dec. fraction 
by a 2-digit dec. fraction. 

86. The student will be able to 
multiply a 3-digit dec. fraction 
by a 2-digit dec. fraction. 

87. The student will be able to 
multiply a dec. number with 

2 ^ec. places by a dec. number 
with 1 dec. place. 

Division of Decimal Numbers 

88. The student will be able to 
divide a 2-digit dec. fraction 
by a 1-digit dec. fraction. 



Many 



Many 



Many 



Many 



Many 



Many 



Many 



Many 



All 



All 



Many 



Many 



Many 



Many 



Many 



Many 



40fo 
32/0 

30/c 
32/0 

llfo 

9fo 



Many 



All 



87 



% of students 
mastering each 
ob,iective 



Rating 

by 
Teachers 



Rating 
by 

"Experts" 



Division of Decimal Numbers continued 



89. 



90. 



91. 



92. 



93. 



94. 



95. 



96. 



97. 



The student will be able to 
divide a 3-digit dec. fraction 
by a 2Hligit dec. fraction. 

The student will be able to 
divide a dec. number with 1-dec. 
place by a 2-'*ligit dec. fraction. 

The student will be able to 
divide a 1-digit dec. fraction 
by a l-digit whole number. 

The student will be able to 
divide a 2-digit dec. fraction 
by a 1-digit whole number. 

The student will be able to 
divide a 3-digit dec. fraction 
by a 2Hligit whole number. 

The student will be able to 
divide a 2-digit whole number 
by a l-digit dec. fraction. 

The student will be able to 
divide a 3-digit whole number 
by a 2Hligit dec. fraction. 

The student will be able to 
divide a 3-digit whole 
number by a 3~<iigit dec. 
fraction. 



Many 



Many 



Many 



Many 



Many 



Many 



Many 



Many 



The student will be able to 
divide a mixed decimal number 
with 3 dec. places by a mixed dec. 
number with 2 dec. places. Many 



Many 



Many 



Many 



Many 



Many 



Many 



Many 



Many 



Many 



31% 



1% 



1^ 
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Rating 

by 
Teachers 



Rating % of students 

by mastering each 

^^Expe rb s" ob.j e ct ive 



Negative Integers 

* 98. The student will be able to 
add tv/o l-digit negative 
integers. 

99. The student will be able 

to subtract a 1-digit nega- 
tive integer from a 2-digit 
v/hole number. 

100. The student will be able to 
multiply a negative integer 
by a negative integer. 

101. The student will be able to 
divide a 2-digit whole number 
by a negative integer. 

Rounded Numbers (Estimation) 

102. The student will be able to 
round off a 5 -digit number 
to the nearest 10,000. 

103. The student will be able to 
estimate the answer to an 
addition problem to the 
nearest thousand. 

104. The student will be able to 
estimate the answer to a sub- 
traction problem to the nearest 
hundred . 

105. The student will be able to 
estimate the answer to a 
multiplication problem to the 
nearest hundred. 

106. The student will be able to 
estimate the answer to a division 
problem to 'the nearest ten. 



All All 39f« 

Many Many % 

Few Many 13fo 

Few Many ip^o 

All Many 2^o 

Many Many Yf^o 

Many Many 21^ 

Many Many 22^ 

Many Many 8^ 
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Commutative Property 

107* Given an addition problem vrlth 

two positive fractions as addends 
the student will be able to supply 
the missing factor in the com- 
muted form of the problem* Many Many 32^ 

108* Given a multiplication problem 
with 2 positive fractions as 
factors, the student will be 
able to supply a missing fac- 
tor in the commuted form of 

the problem* Many Many yfjc 

Associative Property 

109* Given an open addition equa- 
tion with 3 literal fractions 
as addends parenthesized to 
show a particular grouping of 
addends, the student will be 
able to supply a missing 
addend in the equation paren- 
thesized to show a different 

grouping of addends* Many Many 43?^ 

110* Given a multiplication pro- 
blem Kith 3 positive fractions 
as factors parenthesized to 
show a particular grouping of 
factors, the student will be 
able to supply a missing factor 
in the problem parenthesized 
to show a different grouping 

of factors* Many Many 3'i^ 

Distributive Property 

111* Given an equation in whole 

numbers with a missing factor, 
the student will be able to 
apply the distributive pro- 
perty in supplying the missing 

factor* Many - Many 34?5 
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Distributive Property continued 

112. Given an equation with a 
missing factor, where the 
sum is iiTiplicit in a mixed 
number, the student will 
be able to apply the dis- 
tributive property in 

supplying the missing factor. Many 

Identity Element 

113. The student will be able to 
supply a zero as the identity 
element in an unfinished 
mathematical sentence involving 

the addition of whole numbers. All 

114. The student will be able to 
supply the number 1 as the 
identity element in an un- 
finished mathematical sentence 
involving the multiplication 

of whole numbers. All 

115. The student will be able to 
supply a zero as the identity 
element in an unfinished mathe- 
matical sentence involving 
addition of positive fractions. All 

116. The student vdll be able to 
supply the number 1 as the 
identity element in an un- 
finished mathematical sentence 
involving the multiplication 

of positive fractions. Many 

Inverse Relation 

111. The student will be able to 

supply a missing whole number 
in a pair of unfinished mathe- 
matical sentvnces illustrating 
the inverse relationship between 
addition and subtraction. Many 



Many 



39/0 



Many 



v4 



Many 



Many 



65% 



Many 



Many 
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Inverse Relation continued 

118. The student vri.ll be able to 
supply a missing positive 
fraction in a pair of unfinished 
mathematical sentences illus- 
trating the inverse relation- 
ship between multiplication and 
di"'/ision. 

Number Sequences 

119* Given a sequence of whole num- 
bers in which the alternate 
terms are in arithmetic pro- 
gression vri.th a negative 
difference, the student vri.ll 
by able to supply the numbers 
missing from the sequence. 

120. Given a sequence of whole 
numbers involving multipli- 
cation by a constant value, 
the student vri.ll be able to 
supply a missing number from 
the sequence. 

121. Given a sequence of whole 
numbers involving di^rlsion 

by a constant value, the stu- 
dent vri.ll be able to supply 
a missing number from the 
sequence. 

122. Given a sequence of positive 
fractions vri.th like denomina- 
tors and vri.th numerators pro- 
gressively increasing by a 
constant value, the student 
v/ill be able to supply a 
missing number from the se- 
quence. 



Many 



Many 



21^ 



Many 



Many 



Wo 



Many 



Many 



Many 



Many 



29fo 



Many 



Many 



6&fo 
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Number Sequences continued 

123. Given a sequence of positive 
fractions with like denomina- 
tors and vdth numerators pro- 
gressively decreasing by a con- 
stant value, the student vdll 
be able to supply a missing 

number from the sequence. Many Many 54?^ 

124. Given a sequence of positive 
fractions involving multipli- 
cation by a constant frac- 
tional value, the student wil 
be able to supply a missing 
number from the sequence. 

125. Given a sequence of positive 
fractions involving division 
by a constant value, the stu- 
dent vdll be able to supply 
a missing number from the 
sequence. 

Missing Addends and Factors (Transform) 

126. Given an addition problem vdth 
2 addends and their sum but 
the digits missing from 1 ad- 
dend, the student vdll be able 
to supply the missing digits. 

127. Given a completed subtraction 
problem v/ith missing digits in 
the subtrahend and the difference! 
the student vdll be able to 
supply the missing digits. 

128. Given a multiplication pro- 
blem v^ith its product but 
vdth one missing factor, 
the student vdll be able to 
supply the missing factor. 



Many 



Many 



Many Many 



Many 



Many 



5^0 



Many 



Many 



Many 



Many 



93 



Rating Rating 

by by 
Te ache rs '^Expe rt s" 



% of students 
mastering each 
objective 



Missing Addends and Factors (Transform) continued 



129 • Given a division problem 

with its quotient but with 
digits missing from the 
dividend, the student will 
be able to supply the missing 
digits. 

Number Theory 

130. Given a set of whole numbers, 
the student will be able to 
select those which are prime 
numbers. 

13 1* Given a set of whole numbers, 
the student will be able to 
select those which are 
composite. 

132. Given a sequence of odd 

numbers, the student will 
be able to supply additional 
terms in the sequence. 

Mathematical Sentences 

133 • The student will be able to 

specify all the whole numbers 
that fall between 2 given 
whole numbers, (inequalities) 

Measurement 

134» Given a ruler marked off into 
hal-*^ units, the student will 
be able to estimate the length 
of any given object to the 
nearest half unit. 



Many Many 4^ 

Many Many ifo 

Many Many 2fo 

Many Many 6ofo 

Many Many 21^ 

Many All 42^ 
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Measurement continued 



13 5 • Given an arbitrary \mit of 
length, the student will be 
able to measure the length 
of a given object as a num- 
ber of these units, (non- 
standard units) Many 

136. The student will be able to 
convert a given length ex- 
pressed in inches to its 
equivalent in centimeters*^ 
(Metric system) Few 

^ 137. The student will be able to 
use a ruler to measure an 
object's length. All 

^ 13B. The student will be able to 

add lengths expressed in inches 

and convert the sum to feet 

and inches. All 

139. The student will be able to 
subtract lengths expressed 
in yards, feet, and inches 

with regrouping. Many 

140. Given an illustration of a 
liquid thermometer, the 
student will be able to 
specify the temperature to 

the nearest degree. All 

141« Given a dra;ving of a rec- 
tangle with d?jnensions marked 
the student will be able to 
compute the perimeter. Many 



All 



2Sfo 



Many 



All 



All 



Many 



41/0 



3lfo 



All 



All 
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Measurement continued 



11^ • Given a drawing of an area 
that has been subdivided 
into uniform squares, the 
student vri.ll be able to find 
the area of the figure as the 
number of these square units» Few 

143 • Given a drawing of a geometric 
volume which has been sub- 
divided into uniform cubes, 
the student will be able to 
find the volume of the figure 
as the number of these cubic 
units» Few 

IhU* The stuaent will be able to 
identify a right angle by 
sight and specify its measure 
as 90 degrees^ Many 

145 • Given a line graph, the stu- 
dent v/ill be able to read the 
value of a point on the line. Many 

146. Given an illustration of pieces 
of money, both bills and coins, 
the student will be able to 
count the total amount. (Concept 
question) All 

* 147# The student vdll be able to 
add expressed amounts of 
i-^oney. All 

^ 148. The student will be able to 

subtract expressed amounts of 

money. All 



All 



28fo 



Marry 



Many 



All 



27fo 



hyjo 



All 



All 



All 



6lfo 
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Measurement continued 



149. The student will be able to 
multiply an expressed amount 

o± money by a whole number. All 

150. The student will be able to 
divide an expressed amount of 

money by a whole number. Many 

151. The student will be able to 
convert liquid measures from 
gallons to quarts. (Concept 
question) Many 

152. The student will be able to 
add quantities of liquid ex- 
pressed as gallons and quarts 

with regrouping. Many 

153 • The student will be able to 

subtract quantities of liquid ex- 
pressed ao quarts and pints with 
regrouping. Many 

154« The student will be able to 
convert measures of weight 
from pourds to ounces. (Con- 
cept question) Many 

155- The student will be able to 
add quantities of weight ex- 
pressed as pounds and ounces 
with regrouping. Many 

156. The student will be able to 

subtract quantities of weight 

expressed as pounds and ounces 
with regrouping. Many 

157* Given an illustration of a 
clock, the student will be 
able to specify the time 
shown. (Concept question) All 



All 



All 



All 



Many 



Many 



Many 



Many 



Many 



All 



OSfo 



57fo 



"^The test ioem did not measure the 
objective . 
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Measurement continued 



158, The student will be able to 
add quantities of time ex- 
pressed as hours, minutes, 

and seconds with regrouping. All Many \jjo 

159. The student will be able to 
subtract quantities of time 
expressed as hours and minutes 

with regrouping. Many Many \jjo 



160. Given the day of the week on 
which a particular date falls, 
the student will be able to name 
the date a given number of weeks 

later. (Calendar) Many Many 33^ 



Place Value 



161. Given the values of the tens' and 
units' positions of a numeralt 
the student will write the nume- 
ral. (0-999) Many All 8lfo 

162. The student will specify the 
value of any digit in a 5 

place numeral. ( 1, 000-99 t 999) Many All 

163. The student will specify the 
value of any digit in a 9 
place numeral. (100,000- 

999,999,999) Many Many 

164. The otudent will specify the 
value of any digit in a numeral 

with 3 dec. places. (O.O-. 999) Many Many 

165. The student will specify the 
value of any digit in a numeral 
with 5 dec. positions. (O.O- 

.99999) Few Many 
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Place Value continued 

166. Given the expanded form of a 

3- digit numeral, the student 
will write the numeral. (Ex- 
panded notation.) 

167. Given the expanded form of a 

4- digit numeral, the student 
will write the numeral. (Ex- 
panded notation) 

168. Given the expanded form of a 

5- digit numeral in powers of 
ten, the student will write 
the numeral. (Exponential 
notation) 

Numeration Systems 

169. The student will convert a 
Roman Numeral containing only 
the symbols I and X to its 
equivalent Arabic numeral. 
(Roman numerals) 

170. The student will convert a 
Roman numeral containing only 
the symbols L and C to its 
equivalent Arabic numeral. 
(Roman numerals) 

171. The student will convert a 
Roman numeral containing 
only the symbols D and M 
to its equivalent Arabic numeral. 

(Roman numerals) Many Many 3^o 

172. The student will convert a 
base-ten numeral to its 
equivalent base-two numeral. 

(Concept question) Many Few k% 



All All Blfo 

Many Many l&fo 

Many Many 37fo 

Many Many 41^ 

Many Many lU^fo 



99 



Rating Rating % of students 

by by mastering each 

Teachers "Experts " objective 



Numeration Systems continued 



173. The student vri.]l add 2 

base-two numerals. Many 

The student vri.ll subtract a 
base-two numeral from a 
numerically larger base- 
two numeral. Few 

175. The student will convert a 
base-ten numeral to its 
equivalent base-five numeral. 
(Concept question) Many 

176. The student will add two base- 
five numerals. Many 

177* The student will subtract a 
base-five numeral from a 
numerically larger base-five 
numeral. Many 

178. The student will convert a 
base-six numeral to its 
equivalent base-ten 
numeral. Few 

179 • The sLudent will convert a 
base-eight numeral to its 
equivalent base-ten numeral. 
(Concept question) Many 

180. The student will add two 
base-eight numerals. Many 

181. The student will subtract a 
base-eight numeral from a 
numerically larger base- 
eight numeral. Few 



Few 



Few 



Few 



Few 



16^0 



2(^0 



5fo 



lOfo 



Few 



Few 



Few 



Few 



2fo 



Few 



2fo 
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Numeration Systems continued 

182. Given a 2-digit base-ten nume]>- 
al, the student will find its 
value as a modular 5 numeral. 
(Concept question) Few 

183. The student will specify missing 
numerals in a matrix for a 

modular 3 system under addition. Few 

184. The student will specify missing 
numerals in a matrix for a modu- 
lar 3 system under multiplica- 
tion. Few 

Non-metric Geometry 

* 185* Given a set of geometric drawings; 
the student will be able to 
select the one that repre- 
sents a line segment. All 

186. The student will be able to 
state the number of lines of 
symmetry a square has. Many 

187. Given a set of geometric 
drawings, the student will be 
able to select the one that 
represents a prism. Many 

188. Given a set of geometric 
drawings, the student will 
be able to select the one 

that represents a ray. Many 

189. Given a set of geometric 
drawings, the student will 
be able to select the one 
representing the intersection 

of two planes. Many 



Few 



Few 



Few 



15/0 



1^0 



All 



Many 



Many 



Many 



2afo 



Many 



3% 
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^190. Given a set of geometric 

drawings, the student will be 
able to select the one that 
represents parallel lines. 

191» Given a set of geometric 

drawings, the student will be 
able to select the one that 
represents congruence. 

192. Given a mathematical sentence 
expressing the equality of the 
product of two symbolic quan- 
tities with the product of two 
other symbolic quantities, the 
student will be able to ex- 
press true proportions using 
these four quantities. (Ratio 
and Proportion) 

193 • Given the scale of a map, the 

student will be able to compute 
the distance between any two 
points. 

194^ Given a drawing representing 

a map with latitude and longi- 
tude labeled, the student will 
be able to specify the coordi- 
nates of a given point on the 
map. 

195 • Given a set of geometric 

drawings, the student will be 
able to select the one that 
represents the Pythagorean 
Theorem. 



All All Ulfo 



Many Many ^2ffo 



Many Few 13^ 

Many Many &fo 

Few Many 11^ 

Fe^-; Many 3&fo 
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196. Given a set of geometric 

dravdngs, the student will be 
able to select the one that 
represents a quadrilateral 
which is also a parallelogram 
and a rhombus. (Polygon 
classification) 

197« Given a Cartesian coordinate 

grid, the student vn.ll be able 
to name a given point as an 
ordered pair of numbers. 

Percent 

^ 198. The student will be able to 
convert a number written as 
a fraction with denominator 
100 to percent form. (Denomin- 
ator of 100) 

199. The student will be able to 
convert a number written as a 
percent to a fraction. (Equi- 
valent ratios) 

200. The student will be able to 
convert a number written as a 
dec. number to its equivalent 
percent form. (Percents 
between 0 and 100) 

201. The student will be able to 
convert a number written as a 
fraction with denominator 
1000 to percent form. (Per- 
cents less than l) 



Many Many 69^ 

Few Many lOfo 

All All 27fo 

Many Many 10^ 

Many Many ifo 

Few Many 17^ 
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Percent continued 

202. -The student will be able to 
convert a number greater than 
unity written as a fraction 
to percent form. (Percents 
greater than 100) 

203. The student will be able to 
compute a given percent of 
a given whole number. 
(Applications) 



Sets 



204. 



Given a set of less than 10 
elements, the student will 
count the elements. (Pictor- 
ial sets) 



205. Given a set containing whole 
numbers as elements, the stu- 
dent will identify all ele- 
ments that are "more than" 

or "less than" a given 
number. (Listing elements.) 

206. Given two finite sets, the 
student will specify the set 
that is the union of these 
sets. (Union) 

207. Given two finite sets, the 
student will specify the set 
that is the intersection of 
these sets, (intersection) 

208. Given 2 sets of objects^ the 
student will find the number 
of pairings possible when each 
element of the first set is 
paired with each element of 
the second set. (Cartesian 
product ) 



Few 



Many 



Many 



Many 



12/a 



All 



All 



94/a 



All 



All 



Many 



Many 



All 



Many 



22/0 



45/0 



Many 



Many 



104 



Rating Rating % of students 

by by mastering each 

Teachers "Experts" objective 



Statistics 

209 • Given a set of whole numbers, the 
student will be able to com- 
pute their average • (Mean) All Many 2(^o 

210# Given a set of whole numbers, 
the stixdent will be able to 

find their range • Many Many 1^ 

Probability 

211» Given the number of each of 

two kinds of objects in a con- 
tainer, the student will be 
able to compute the probabi- 
lity of selecting one of a 
given kind at random. (Simple 

events) Many Many 0$ 

Reasoning 

212# Given a word problem requiring 
one or more fundamental opera- 
tions with small whole numbers 
for solution, the student will 

be able to solve the problem. Many Many 
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APPENDIX H 



SUMMARY OF REPLIES 
TO EVALUATION INSTRUMENTS 



SURVEY FORM FOR SCHOOL CONTACT PERSONS 

This instrument was provided to the assessment contact persons in educa- 
tion service centers for use in pre-test workshops for school personnel. 
These results were obtained from 192 participants in the nine ESC re- 
gions that reported • 

• of the workshop participants indicated that they 
had no previous exposure to criteriornreferenced test- 
ing. 

• considered the idea of a criterion-referenced assess- 
ment very appealing and they thought the results would 

be useful in planning classroom instruction. 

• responded that they believed test results based on 
measurable objectives would be useful for tailoring pro- 
grams to the continuous progress of pupils in the partici- 
pants* schools. 

. 959^ thought criterion-referenced measures would give more 
information to teachers about students than nonn-ref erenced 
tests. 

. 68?J of the participants were confident of their ability 
to explain criterion-referenced concepts to another 
person or to implement the test results. 

SURVEY OF TEACHER OPINION I 

A survey questionnaire was distributed in October 1971 through the ESC 
assessment contact person to sixth-grade mathematics teachers in a sam- 
ple of the schools participating in the assessment project. The survey 
was conducted during this phase of the assessment to- gather a series of 
initial reactions to the assessment procedures and instmaments after they 
had been administered and before results from the assessment instruments 
had been returned to the schools. The following results were the opin- 
ions of 213 respondents from the statewide sample of teachers • 

. stated that this was their first experience with 

criterion-referenced testing. 
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• 71% of the teachers felt that they understood the princi- 
ples of criterion-referenced testing in a range from 
satisfactory to very well^ 

• 60fo of the teachers thought the test results would be 
useful or very useful for planning classroom instruction. 

• 70fo thought they were adequately prepared to make use of 
the test result?. 



• Vfhen asked about the method by which they would prefer to 
receive information about test administration if they partici- 
pated in another assessment, 31% checked "printed materials 
only," 395^ checked "conversation" or "group discussion," 
21% indicated a preference for "lecture with aiidio-visual 
equipment," and only 2% wanted just "lecture." 

. In response to the question, "If you were planning to pre- 
pare teachers for participation in next year's assessment 
project, which items would you stress in your presentation?", 
595^ felt information on the use of the test data was impor- 
tant, 42^ stated "explanation of criterioi>-referenced tests" 
should be stressed, 40^ of the teachers checked "test admini- 
stration detail," and 12^ checked "time schedules and dead- 
lines." 



EVALUATION FOBM - POST-TEST WORKSHOP 



An evaluation form was distributed to school personnel who attended post- 
test workshops in each of the 20 ESC regions during January 1972. The 
participants were asked about how well they thought the objectives for 
the workshops were met. The form contained a five-point scale with one 
being the lowest. The mean score of the participants' ratings are given 
in parentheses after each objective. (5 = highest possible score) 

. Information about the rationale for the assessment project 
(4.2) 

. Awareness of the implications of criterioi>-referenced testing, 
the rationale for comparing classroom objectives, and the 
objectives measured by the test instruments (4«l) 

. Awareness of the potential of criterioi>-referenced test re- 
sults for promoting the continuous progress of pupils (4«3) 

. Gaining skills in using the diagnostic and prescriptive 
information from criterion-referenced tests for identifying 
pupil learning needs (4#0) 
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• Understanding of how to use these results to plan instruc- 
tion for individuals and groups of pupils (4.0) 

SURVEY OF TEACHER OPINION II 

The final questionnaire for this evaluation procedure was distributed to 
sixth-grade mathematics teachers in the same sample of schools that were 
selected for the first "Siirvey of Teacher Opinion," in February 1972. 
This survey was distributed at this time to secure teacher reactions 
about the total assessment project after most of them had the opportunity 
to study and use the restdts from the criterionr-referenced tests* 

Of the 254 respondents to the survey, 249^ were replying after receiving 
results from the Prescriptive Mathematics Inventory (FMI), only 29^ in 
reference to the results from the Prescriptive Reading Test (PRT), and 
479^ after receiving results from both tests* 

• When asked if the results were particularly helpful in 
classroom instructional planning - 43^ replied no, 57^ 
replied yes. Of the "no" replies, most responded: the 
results arrived too late (33% gave this as one reason for 
responding "no"), the restdts were not adaptable to their 
classroom situations, and the test(s) were not appropriate 
for their classes, so the results were not meaningful. Of 
the teachers marking "yes", most gave: "identifying pupil 
weaknesses in skills, identifying areas of the curriculiom 
needing study, and identifying special pupil abilities" as 
their reasons for replying in this manner. Another ques- 
tion on the survey asked the teachers to rate the usefiilness 
of criterionr-referenced test results for classroom instruo- 
tional planning and the mean of the rating was 4.4 on a 

six point continuTom (six was the highest possible rating). 

. When asked if the test infonnation was adequate for the 
teacher's purposes - 2% responded no, 72^5 responded yes. 
Of the "no" replies, comments indicated that the primary 
reasons for this response were the late arrival of results 
which caused thOT to be less useful, the tests were too 
difficult for sane groups of students, and the test inform 
matdon did not fit the teachers' classrocwn situations. 

. When asked if the benefits derived from the assessment were 
sufficient to justify the school time devoted to partici- 
pation - 23% replied "no", 52% "yes", and 2% "did not know." 

. When teachers were asked to respond to hypothetical situa- 
tions involving diagnosis of pupils' learning skills and 
were asked to rank a list of alternatives for achieving the 
diagnosis, they ranked standardized criterion-referenced 
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testing as their first choice for determining individual 
differences to plan instruction early in the school year 
and for evaluating the degree to which the pfupils had 
attained the larger out canes of the course near the end of 
the school year. The teachers ranked teache]>-made testing 
as a first choice for determining the degree to vdiich stvr- 
dents had mastered learning tasks at midyear and teache3>- 
made criterion-referenced testing as a first choice as a 
means of obtaining evaluative data on pupil mastery of over- 
all course out canes for grading and reporting purposes. 

When teachers were asked to rate the extent to vrtiich the 
various foims in which test results were repoirted to schools 
assisted teachers, they responded: The Diagnostic Matrix 
for Individual Pupils and Individual Study Guides provide 
the most assistance; the Master Reference Guide was of 
least assistance. 

When asked to compare the results of criterion-referenced 
testing to the results of noiro-referenced testing for 
instructional planning, the teachers gave criterion-referenced 
testing a mean of 3^*17 on a 4 point continuum. 

When asked about revisions in the test instruments, the major 
change recommended by teachers for both tests was simplifi- 
cation of the vocabulary used in test questions and, in the 
case of the PMI, to revise the way pupils record their 
answers. 

When asked about the best procedures for administering tests 
of this type in the future, about 65^ of the teachers responded 
that they would administer the test in the regular classroom 
and about the same percentage indicated that they would pre- 
fer to administer th^ in the morning. 

When asked about the helpfulness of post-test workshops 
83?^ reported that the workshops had been of help to them. 
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Errata - SIXTH GRADE MATHEMATICS, A Need Assessment Report 



the Sixth Grade Mathematics Needs Assessment Report the percentage of 
students mastering each objective has been reported incorrectly for the 
objectives grouped under the heading Non-metric Geometry , objective 
numbers 185-196. The following table gives the corrected percentage of 
students mastering each objective for Appendix E, pages 101-103, of this 
report. This corrected table also serves as a reference for the corrected 
percentage of mastery for aiiy discussion of student attainment of these 
objectives in the body of the text. 



NON-METRIC GEOMETRY 



Corrected % of 

^ students mastering 
each objective 

185 - line segment 

186 - symmetry ir^^ 

187 - prism 20fo 

188 - ray 

189 - intersection (lines and planes) 41^ 

190 - parallel lines 52^ 

191 - congruence 

192 - ratio and proportion 5^ 

193 - map reading, scale dravdng 3^ 

194 - latitude and longitude 6^ 

195 - Pythagorean theorem ^ 

196 - polygon classification 



-2- 



A corrected table giving the percentages of mastery by population groups, 
Appendix F, for the Non-metric Geometry objectives, objectives numbers 
185-196, page II3, can be obtained by contacting the Division of Program 
Planning and Needs A ssessment . Texas Education Agency . 201 East 11th Street. 
Austin. Texas 78701 . ' 

. Objective number 44, page 83, should have an asterisk by the side of the 
number indicating it was selected as a basic objective. 
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